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Internal    auditors  must  evaluate  external   auditors' 

recommendations  for   changes   in  the  internal  auditors' 

systems  of    internal   controls.      This  study  examines  some  of 

the  factors   that   influence  internal  auditors  in  their 

evaluation.      An  experiment  was  performed  using  125   internal 

auditors  as   subjects.      Each   subject  was   presented  with  four 

scenarios  which  emphasized  each  of  four   factors  that  were 

thought  to  influence    the   internal   auditors'    decision 

processes:    (1)    costs  and   benefits  of    the   change,    (2)    source 

of   the  recommendation,    (3)   tone   of   the  recommendation,   and 

xii 


(4)    importance   of   the  internal    control   procedure  being 
changed. 

Results  indicated  that  the  first  factor  was 
consistently  the  most  important  influence  on  the   decision 
makers.      Factors  two,    three,    and  four  varied  in  relative 
importance  depending  on  circumstances  specified  in  the 
scenarios. 
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CHAPTER  I 
INTRODUCTION 

Corporate  managers  are  responsible  for  safeguarding  the 

assets  and  assuring  the  reliability  of  the  corporation's 

financial  statements.   In  all  but  the  smallest  firms, 

management  must  fulfill  these  responsibilities  by  installing 

and  maintaining  a  system  of  internal  controls. 

The  establishment  and  maintenance  of  a  system 
of  internal  control  is  an  important 
responsibility  of  management.   The  system  of 
internal  control  should  be  under  continuing 
supervision  by  management  to  determine  that 
it  is  functioning  as  prescribed  and  is 
modified  as  appropriate  for  changes  in 
conditions.   [AICPA,  1982,  section  AU320.31] 

Internal  auditors  play  a  major  role  in  managers' 
efforts  to  maintain  an  effective  and  efficient  system  of 
internal  control.   In  particular,  internal  auditors  are 
involved  in  the  process  by  which  managers  modify  the  system 
in  response  to  changed  conditions.   This  study  focuses  upon 
internal  auditors'  responses  to  recommended  changes  in 
internal  control  systems.  Through  experimentation,  this 
study  seeks  to  provide  empirical  evidence  that  will 
facilitate  understanding  of  the  process  by  which  internal 
control  systems  are  modified. 

The  primary  purposes  of  this  first  chapter  are  to 
identify  and  describe  the  research  issue  and  to  justify  its 


importance  as  a  topic  for  research.   The  first  two  sections, 
therefore,  consist  of  a  brief  presentation  of  the  research 
issue  and  of  the  motivations  that  led  to  the  choice  of  the 
research  topic.   In  the  next  section,  the  specific  role  of 
the  internal  auditor  in  the  process  of  modifying  internal 
control  systems  is  examined.   The  remaining  sections 
provide  a  summary  of  the  empirical  study  that  was  designed 
to  address  the  research  issue.   The  empirical  study,  which 
used  practicing  internal  auditors  as  subjects,  is  reported 
in  depth  throughout  the  remaining  chapters. 

The  Research  Issue 

The  internal  audit  staff  is  responsible  for  reviewing 
the  system  of  internal  control  and  evaluating  internal  and 
external  criticisms  of  the  system.   One  common  source  of 
external  criticism  is  the  external  auditor's  "management 
letter."  Therefore,  the  focus  of  this  study  is  the  response 
of  internal  auditors  to  the  types  of  criticisms  that  are 
often  found  in  letters  to  management. 

It  is  important  to  know  why  internal  auditors  respond 
to  criticisms  of  their  internal  control  systems  for  several 
reasons.   These  reasons  can  be  categorized  by  the  viewpoints 
of  several  interested  parties. 

Internal  auditor's  point  of  view.  The  internal  auditor 
should  be  aware  of  the  relative  importance  of  various 
factors  on  his  decision  process.  This  awareness  will  help 


him  reconcile  his  method  of  approaching  his  job  with 
management's  expectations  of  him.   In  this  sense,  the 
factors  that  influence  his  opinion  are,  to  some  degree,  a 
measure  of  his  professionalism  and  independence. 

External  auditor's  point  of  view.  The  external  auditor 
is  frequently  the  source  of  the  criticism.   It  would  be  in 
his  interest  to  have  a  better  understanding  of  the  impact  of 
his  communication  in  order  to  make  it  more  effective. 

Audit  committee's  point  of  view.  The  audit  committee 
must  motivate  the  internal  auditors  and  engage  the  external 
auditor  in  a  way  designed  to  make  the  interests  of  the 
internal  auditors,  external  auditors,  audit  committee,  and 
shareholders  coincide  as  much  as  possible.   For  this  reason, 
the  audit  committee  must  be  informed  about  the  factors 
influencing  the  internal  auditors'  decisions. 

Unfortunately,  not  much  is  known  about  how  internal 
auditors  respond  to  criticisms  of  their  system  of  internal 
controls.   Therefore,  this  study  is  an  empirical  attempt  to 
describe  the  relative  importance  of  some  of  the  factors  that 
influence  the  internal  auditor's  decision  process. 

Motivation  for  the  Study 
Three  forces  in  the  current  business  environment 
heighten  the  importance  of  research  in  this  area.   These 
are  (1)  the  increasing  importance  of  corporate  audit 


committees,  (2)  the  Foreign  Corrupt  Practices  Act  (FCPA) , 
and  (3)  the  impact  of  EDP-related  fraud. 

Corporate  audit  committees.  It  is  becoming  common  for 
the  directors  of  large  corporations  to  establish  audit 
committees.  The  audit  committee  is  the  body  ultimately 
responsible  for  the  maintenance  and  organization  of  internal 
control.   This  responsibility  is  based  in  the  Foreign 
Corrupt  Practices  Act  (FCPA),  Securities  and  Exchange 
Commission  (SEC)  release  no.  34-15772,  New  York  Stock 
Exchange  (NYSE)  rules,  and  The  Statement  of  Auditing 
Standards  (SAS)  section  320.28  [Baruch,  1980  p.  17  4-5]. 

Among  other  things,  the  audit  committee  must  decide 
issues  involving  changes  in  the  system  of  internal  controls. 
Furthermore,  it  must  document  those  decisions.   Therefore, 
the  more  important  audit  committees  become,  the  more 
important  it  is  to  understand  the  method  by  which  audit 
committees  obtain  their  information  and  document  it. 

The  reason  an  audit  committee  must  carefully  document 
its  work  is  illustrated  by  the  fact  that  the  FCPA  does  not 
provide  "definitive  criteria  for  management  to  use  in 
evaluating  the  adequacy  of  its  system  of  internal  accounting 
control"  [Neumann,  1981,  p.  79].  Yet,  the  audit  committee 
is  responsible  for  the  quality  of  the  internal  control 
system.   Therefore,  the  committee  should  document  the  extent 
of  its  efforts  to  achieve  an  acceptable  system. 


Even  though  the  NYSE  requires   domestic   companies   traded 
on  the  exchange   to  have  corporate  audit  committees,    the 
duties  of   the  committees  have   not   been  specified   by  any  of 
the   authoritative   organizations   involved    [Baruch,    1980,    p. 
174].      However,    there  is  an  increased  popularity,    or   demand, 
for   the  audit   committee.     Reasons  given  for    this   increased 
popularity  of   the  corporate  audit  committee  range  from 
"heightened  public   awareness  of   corporate   responsibility"  to 
"management's   desire   for    self-regulation"    [Neumann,    1981,    p. 
78].      One   reason  for   the   increasing   importance   of   corporate 
audit  committees  is  suggested  by  Neumann:    a  lack   of  audit 
committee   participation  might  be  viewed  by  the  SEC  as  a 
weakness   in  internal   control   under    the   FCPA. 

Tmpact   of   the   Foreign   Corrupt   Practices  Act.      The 
second  force  in  the   current   business  environment   that 
increases  the  importance   of    research   in  this  area   is  the 
impact   of   the   FCPA.      The   FCPA  has  focused  attention  on 
internal    control   as  a   social    issue.      It  has  also   redefined 
the  responsibilities   of   corporate   boards   of   directors.      Even 
though  the  Act  was  initiated  as  a  measure  to  inhibit  the 
bribery  of   foreign   officials,    it  has  had  a   significant 
impact   in  directing  accountants'   attention  to  the   importance 
of   internal   controls   beyond  those   necessary  to  insure   the 
fairness  of   financial    statements.      Thus,    it  provides  a 
motivation  for  examining  the  mechanisms  through  which 
changes   in   internal    controls  occur. 


EDP-related   frauds.     The   third   force   in   the   current 
business  environment   is  the   increasing  frequency  and  rising 
dollar   amount   of   EDP-related  fraud.      This   is,    of   course,    a 
result  of   increasing   reliance   placed  on  computers  by  modern 
business.      The  result  is   due   to  a   perverse   relationship 
between  fraud  and  business  use   of   computers.     Business   is 
able   to  increase   productivity  and   efficiency  by   using 
computers.      At  the  same  time,    computers  provide  an 
environment  in  which  frauds  can  take  place  faster   and  with 
larger   dollar    consequences   than  ever   before. 

Increased  fraudulent  activity    [Allen,   1977,    p.    52]    also 
has  an  impact   on  the  cost-benefit   structure  of   internal 
control  decisions  because   of   the   impact  on   the   probability 
of   errors.     One  way  of   measuring  the  dollar  value   of   a 
control   is  to   compute   the   conditional   probability  that  a 
fraud  will   be   prevented  by   a  control,   given  the  probability 
that  the  attempt  at  fraud  will   occur.      Therefore,    if   the 
probability  of   an  EDP-related  fraud  increases,    then  the 
benefit   of  a   control   designed  to   detect   or   prevent   such  a 
fraud   also    increases. 

Because   the  increase   in  EDP-related  fraud  has  a   direct 
impact  on  the   costs  and   benefits  of   internal   control 
procedures   used  to  protect   the  firm    in  an  EDP-environment, 
the  increased  number   and  value   of  EDP-related  frauds 
provides  a    strong  motivation  to   study   internal   auditors' 


responses  to  suggested  changes  in  EDP-related  internal 
controls. 

The  Selection  of  Internal  Auditors  as  Subjects 
As  it  becomes  more  common  for  the  directors  of  large 
corporations  to  establish  audit  committees,  the  link  between 
corporate  responsibility  for  internal  controls  and  the 
importance  of  the  internal  audit  group  becomes  clearer. 
The  audit  committee  is  the  body  ultimately  responsible  for 
the  maintenance  and  organization  of  internal  control. 
Hence,  the  audit  committee's  responsibility  is  higher 
than  management's  responsibility  because  it  must  include 
control  of  management  itself.  Corporate  organizations  are 
often  arranged  such  that  professional  management  is  directly 
responsible  to  the  corporate  audit  committee.  One  of  the 
management  groups  that  reports  directly  to  the  audit 
committee  is  the  internal  audit  group.  The  audit  group 
advises  the  audit  committee  on  matters  concerning  the 
establishment  and  maintenance  of  a  system  of  internal 
control.   Therefore,  in  the  event  of  an  external  auditor's 
criticism,  the  audit  committee  will  rely  heavily  on  the 
internal  audit  group's  recommendation  [Mautz  and  Neumann, 
1977,  p.  62],   These  considerations  underlie  this  study's 
focus  on  the  internal  audit  group's  reaction  to  externally 
generated  suggestions  for  changes  in  the  system  of  internal 
controls. 
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The  External  Auditor's  Recommendation 
Organizations  which  depend  on  the  protection  afforded 
by  a  system  of  internal  controls  should  have  that  system 
periodically  reviewed.   The  review  of  a  system  of  internal 
controls  often  leads  to  criticisms  and  related  suggestions 
for  "improvement."  Those  criticisms  and  suggestions  that 
come  from  parties  external  to  the  corporate  entity  are  the 
focus  of  the  present  study. 

The  response  of  a  firm  to  external  evaluation  of 
internal  control  may  be  a  function  of  to  whom  the  criticism 
is  directed,  the  source  of  the  criticism,  and  whether  or  not 
the  firm  solicited  the  criticism.  This  study  is  concerned 
with  solicited  evaluations,  coming  from  responsible  sources 
and  directed  to  the  board  of  directors.  The  most  important 
sources  of  such  evaluations  are  external  auditors. 

The  process  that  gives  rise  to  an  external  auditor 
recommending  an  "improvement  in  the  client's  system  of 
internal  controls"  is  closely  related  to  the  type  of 
engagement  in  which  the  external  auditor  is  involved.  The 
most  common  involvement  between  an  external  auditor  and  his 
client,  resulting  in  recommended  changes  in  internal 
control,  is  the  typical  audit  of  the  client's  financial 
statements  (hereafter  referred  to  as  a  standard  audit). 
While  other  types  of  auditing  engagements  are  possible 
(audit  of  internal  control,  report  to  regulatory  agencies, 
audit  of  a  special  problem  area),  the  standard  audit  will 


serve  to  illustrate   the   relationship  between  the   external 
auditor    and  his   client's   system    of    internal   controls. 

In  an  audit   of   financial    statements,    the  external 
auditor   predicates  the  amount   of   substantive   testing  on  his 
evaluation  of   the   client's   system   of   internal    controls  and 
his   cost-benefit   analysis   of   various  auditing  techniques. 
The   process   by  which   the  external   auditor's   evaluation 
affects  the  extent   of    substantive   testing   is   sequential   in 
nature.      Intuitively,    it  would  appear   that   the  more   positive 
the   auditor's   evaluation   of    his   client's   internal    control, 
the  more  confidence   the  auditor  would  have   in  his  opinion  as 
to  the   soundness   of   the  client's  financial    statements.      This 
proposition  is  supported   by  Brown    [1977]    in  presenting  her 
financial-analyst's  view   of   the   impact   of    stronger   internal 
controls  on   the  auditor's   report   and   the   analyst's 
evaluation  of   the  client.      On  the  other  hand,    the 
authoritative   pronouncements    [AICPA,    1982,    Section  AU642.10] 
indicate    that   the   external    auditor's  evaluation  of   his 
client's   internal    control    system    should   not    (theoretically) 
influence  his  level   of   confidence   in  his  audit  opinion,    even 
if   the  auditor   relied  on  that   system   in  forming  his  opinion. 
This  is  because   other   audit  procedures    (analytical    review 
and  substantive   testing)    can   compensate  for    the   degree   of 
reliance    on   internal   controls. 

It   is  common  for   external   auditors  to  find  weaknesses 
in  the   client's   system   of   internal   controls    during   the 


10 

course  of  a  standard  audit.   In  such  an  event,  the  external 

auditor  must  report  such  weaknesses  to  management  or  to  the 

audit  committee  [AICPA,  1982,  section  AU323.01  amended  by 

section  AD642.62].   It  alBO  should  be  noted  that 

suggestions  or  other  comments  concerning 
accounting  control  and  various  other  matters 
are  often  submitted  to  management  by  auditors 
as  a  result  of  observations  made  during  their 
examinations  of  financial  statements.  These 
comments  are  often  submitted  by  letters, 
memoranda,  and  other  less  formal  means.  This 
practice  is  encouraged.  .  .  .  [AICPA,  1982, 
section  AU642.53] 

As  a  result,  most  audits,  even  though  they  may  be 
audits  of  the  financial  statements  and  not  internal  control 
audits  per  se,  result  in  an  "internal  control  letter"  to 
management.  These  management  letters,  identifying 
weaknesses  in  the  client's  internal  control  system,  are 
frequently  accompanied  by  recommended  changes  to  the  system. 

While  the  study  is  concerned  primarily  with  independent 
external  auditors'  recommendations,  solicited 
recommendations  from  external  systems  analysts  have  been 
included  for  comparison.   Both  of  these  sources  are 
considered  highly  responsible;  the  major  difference  is  that 
external  auditors'  recommendations  are  usually  packaged  with 
other  auditing  services,  while  a  systems  analyst's  services 
are  solicited  for  a  particular  purpose. 

Description  of  the  Study 
The  study  analyzed  the  responses  of  125  subjects 
(internal  auditors  and  controllers),  to  external 
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recommendations  for  changes  in  the  system  of  EDP-related 
internal  controls.   Subjects  were  asked  to  assume  that  they 
were  internal  auditors  who  had  to  make  a  recommendation  to 
the  audit  committee  as  to  whether  the  proposed  change  should 
be  implemented.   Forty-eight  different  scenarios  were  used. 
However,  each  subject  was  required  to  participate  in  only 
four  scenarios. 

The  scenarios  varied  across  four  dimensions.   Each  of 
the  dimensions  is  listed  below  with  a  brief  description.   A 
more  detailed  description  is  found  in  Chapter  III.  The 
dimensions  (independent  variables)  are  (1)  the  strength 
with  which  the  external  recommendation  was  made,  (2)  the 
source  of  the  external  recommendation,  (3)  the  type  of  EDP 
controls  in  question,  and  (4)  the  type  of  change  being 
recommended.   The  strength  dimension  refers  to  the  tone  of 
the  communication.   Two  levels  of  strength  were  used:  strong 
and  weak.   The  source  dimension  refers  to  the  two  sources  of 
evaluation:  external  auditor  or  systems  analyst.   The  third 
dimension  deals  with  the  type  of  EDP  controls  which  were  the 
subject  of  the  evaluation.  These  were  three  types:  (1) 
transaction  origination,  (2)  transaction  entry,  and  (3) 
processing.  The  fourth  dimension  deals  with  the  nature  or 
quality  of  the  changes  recommended.  The  four  types  of 
criticisms  are  described  briefly  below  and  are  detailed  in 
Chapter  III. 
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Controls  were  classified  as  either  "complements"  or 

"substitutes."  Complement  (important,  necessary,  needed) 

controls  were  defined  as  controls  whose  addition  or  deletion 

had  a  significant  impact  on  the  overall  effectiveness  of  the 

internal  control  procedure  described  in  the  scenario. 

Substitute  (unimportant,  unnecessary,  not  needed)  controls 

were  defined  as  controls  whose  addition  or  deletion  did  not, 

in  the  author's  opinion,  change  the  overall  effectiveness  of 

the  internal  control  procedure  being  evaluated  in  the 

scenario.   The  terms  "complement"  and  "substitute"  have  been 

used  previously  by  Fisher  in  1978: 

When  two  or  more  controls  both  contribute  to 
reduce  a  cause  of  exposure,  one  needs  to 
determine  whether  they  are  complementary,  or 
actually  increase  assurance  when  used 
together,  or  are  substitutable.  [1978,  p. 
355] 

The  types  of  changes  recommended  were  the  addition  of  a 
control,  the  deletion  of  a  control,  or  the  replacement  of 
one  control  with  another.   Some  of  the  possible  combinations 
were  not  used  (see  Chapter  III).   The  four  types  of 
changes  that  were  used  included  the  following:  (1)  add  a 
complement,  (2)  delete  a  complement,  (3)  delete  a 
substitute,  and  (4)  replace  a  substitute  with  a  complement. 

Subjects  were  asked  to  respond  to  seven  questions  about 
each  scenario  and  ten  questions  about  themselves.  The  seven 
questions  about  each  scenario  addressed  the  following  areas: 

(1)  evaluation  of  the  unchanged  internal  control  procedure, 

(2)  importance  of  the  internal  control  procedure  to  the 
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overall  system  of  internal  controls,  (3)  evaluation  of  the 
changed  internal  control  procedure,  (4)  classification  of 
the  type  of  change  being  suggested,  (5)  relative  importance 
of  four  factors  on  the  subject's  judgment  (source  of  the 
criticism,  tone  of  the  criticism,  subject's  evaluation  of 
the  cost-benefits  associated  with  making  the  recommended 
change,  and  other  factors),  (6)  evaluation  of  the  impact  of 
the  adoption  of  the  recommendation  on  the  quality  of  the 
overall  internal  control  system,  and  (7)  subject's 
recommendation  to  a  hypothetical  audit  committee. 
Organization  of  the  Remaining  Chapters 
Chapter  II  is  devoted  to  background  information  and  a 
brief  review  of  the  literature.   Chapter  III  describes  the 
research  methods  used  in  this  study.   It  includes 
descriptions  of  a  general  model  of  the  problem,  the 
experimental  design,  the  independent  and  dependent 
variables,  instrumental  variables,  the  task  and  the 
instrument,  subjects  used  in  both  pilot  and  field  testing, 
the  experiment,  expected  responses,  and  effects  of  the  pilot 
tests.   Chapter  IV  is  a  brief  description  of  path  analysis. 
Included  are  techniques  for  path  estimation,  differences  in 
path  analysis  and  regression  analysis,  and  models  considered 
in  this  study.   Chapter  V  contains  the  experimental  results 
and  the  analysis  of  those  results.   Chapter  VI  contains 
conclusions  and  suggestions  for  further  research. 


CHAPTER  II 
BACKGROUND  AND  LITERATURE  REVIEW 


The  previous  chapter  included  a  brief  review  of  the 
interrelationship  between  audit  committees,  external 
auditors'  recommendations  relating  to  internal  control 
systems,  and  the  internal  audit  staff  of  corporations.   The 
first  section  of  this  chapter  provides  background 
information  which  shows  that  (1)  external  auditors  use  the 
management  letter  to  communicate  their  critical  evaluations 
of  the  clients'  systems  of  internal  control;  (2)  audit 
committees  consider  it  part  of  their  responsibility  to 
review  these  criticisms;  and  (3)  it  is  a  function  of  the 
internal  audit  group  to  review  the  changes  recommended  by 
the  external  auditor  and  advise  the  audit  committee  of  their 
own  reaction  to  these  recommendations. 

It  is  assumed  that  internal  auditors  evaluate  internal 
controls  primarily  on  a  cost-benefit  basis.   Techniques  that 
have  been  suggested  for  making  cost-benefit  analysis  of 
internal  control  systems  are  reviewed  below.   An  area 
closely  related  to  the  cost-benefit  evaluation  of  internal 
controls  is  the  substitution  of  internal  auditing  for 
external  auditing  to  achieve  more  cost-effective  external 
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auditing.  Whether  or  not  to  include  such  a  trade-off  in  a 
cost-benefit  analysis  is  also  addressed. 

It  is  suggested  that  auditors  have  the  ability  to  make 
expert  internal  control  judgments.   The  body  of  literature 
that  has  grown  around  auditors'  expert  judgment  ability  is 
reviewed  in  the  fourth  section  of  this  chapter. 

Finally,  the  study  is  related  to  a  brief  review  of  the 
source  credibility  literature.   The  source  credibility 
literature  is  used  to  justify  the  expectation  that  there 
will  be  no  difference  between  the  experimental  group  (source 
is  external  auditors)  and  the  control  group  (source  is 
systems  analysts). 

Audit  Committees  and  the  Review  of  Internal  Control 
Criticisms 

The  question  of  who  reviews  criticisms  found  in  a 
management  letter  is  addressed  from  both  descriptive  and 
normative  points  of  view:  Schiff  [1977]  describes  what  is 
being  done,  while  Pomeranz  [1977]  specifies  what  should  be 
done. 

At  the  1977  Ross  Round-Table  Discussions,  Schiff, 
Sorter,  and  Wiesen  examined  "The  Evolving  Role  of  Corporate 
Audit  Committees"  [1977].   Participants  in  the  round  table 
included  "audit  committee  members,  lawyers,  chief  financial 
officers,  practicing  certified  public  accountants,  a 
representative  from  the  SEC,  and  accounting  professors" 
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[Schiff,  1977,  p.  20].   One  of  the  things  to  come  out  of  the 

meeting  was  the  relationship  between  the  internal  audit 

group  and  the  audit  committee.  Basically,  it  was  seen  that 

internal  auditors  review  the  external  auditors'  criticisms 

with  the  intention  of  reporting  their  findings  to  the  audit 

committee. 

The  June  meeting  is  devoted  to  a  review  of 
internal  controls  and  to  gain  assurances  that 
shortcomings  raised  relative  to  procedures 
and  controls  in  the  outside  auditor's 
management  letter  have  been  addressed 
correctly.   [Schiff,  1977,  p.  21] 

The  audit  committee  directly  discusses  any  problems 
with  the  chief  internal  auditor  as  is  evidenced  by  his 
position  in  the  company's  organizational  structure:   "the 
Chief  Auditor's  position  has  been  elevated  to  vice-president 
reporting  directly  to  the  audit  committee"  [Schiff,  1977,  p. 
21].   Therefore,  internal  auditors,  acting  for  audit 
committees,  are  responsible  for  the  review  of  the  criticism 
in  management  letters. 

Pomeranz  pointed  out  that  the  audit  committee  should 
be  concerned  with  "review  of  management  letters, 
specifically  findings  not  acted  upon"  [1977,  p.  46].   He 
emphasized  that  unadopted  changes  should  be  reviewed. 
Furthermore,  he  said  that  the  committee  should  review 
"internal  audit  reports  in  summary  form"  and  consider 
"corrective  actions  not  taken"  [1977,  p.  46],   Thus,  in  many 
cases,  what  is  done  coincides  with  what  should  be  done. 
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Cost-Benefit  Analysis 
There  are  at  least  four  reasons  why  an  external 
organization  reviewing  a   system   of   internal   controls  might 
suggest   a   change:     (1)    the  change   is  deemed  to  be   essential; 
(2)    the   change   is   deemed  to   be  a   binding   constraint   to 
achieving   some   other   goal;    (3)    the  change   is  deemed  to  have 
overriding  qualitative   considerations;   or    (4)    the    change   is 
deemed  to  be   cost-beneficial.      The  four   reasons  listed  are 
certainly  not  mutually  exclusive,   nor   is   the  extent   of   the 
overlap  known.      However,    each   of   the   reasons  is  discussed 
independently. 

Essential   controls  are   those  either   required  by  law   or 
deemed  almost  necessary  from  a  practical  business  management 
standpoint.        An  example  of   a  legally  essential   control    is 
the  requirement   of   the  SEC  Release  No.    34-15722   that   certain 
companies  maintain  an  audit  committee    [Baruch,    1980  pp.    174- 
175].     Control   over  access  to   sensitive   computer  hardware 
and  software  is  an  example  of  a  practical-management 
essential    control. 

Controls  may  become  binding  constraints  in  achieving 
other  goals.      These  controls  become  important  when  the 
primary  goal   with  which   they  are  associated  is  considered. 
For  example,  a  firm  which  is  building  a  submarine  has  as  its 
primary  goal   providing  services  to  the  government  on  a  cost- 
plus   basis.      The   government   insists  on  a   certain   internal 
control   that  would  be  of   minor   importance   in  the  normal 
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course  of  business:  security  over  the  blueprints.   However, 

because  of  government  security  concerns,  the  entire 

opportunity  to  participate  in  the  project  may  be  contingent 

upon  the  firm's  ability  to  show  that  adequate  arrangements 

have  been  made  for  the  physical  security  of  the  blueprints. 

Thus,  physical  control  of  the  blueprints,  not  the  ability  to 

reproduce  them,  is  a  binding  constraint  to  getting  the 

contract. 

Changes  in  controls  suggested  because  of  qualitative 

considerations  are  normative  in  nature.  Qualitative 

controls  are  included  in  a  system  because  of  the  belief  that 

certain  things  should  be  protected  even  if  they  are  not 

material.   Common  business  practices  are  often  qualitative 

controls.   For  example,  restricting  access  to  accounting 

records  such  as  payroll  ledgers  is  both  a  common  business 

practice  and  a  qualitative  control.   Controls  necessitated 

by  qualitative  considerations  may  also  be  essential, 

constraining,  or  cost  beneficial.   DeMiotto  points  out  that 

while  it  is  obvious  that  management  would  not  want 
to  spend  more  for  a  control  procedure  than  the 
benefit  to  be  derived  from  achieving  a  particular 
control  objective,  it  is  important  to  remember 
that  cost  considerations  do  not  only  encompass 
direct  monetary  effects.   They  include  qualitative 
effects  as  well.   [1980,  p.18] 

This  study  is  not  designed  to  examine  qualitative, 

essential,  or  constraining  controls;  however,  the  controls 

that  are  studied  may  also  be  so  classified.  The  main  thrust 

of  this  study  is  to  examine  internal  auditors'  reactions  to 
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external  auditors'  recommendations  for  control  changes  from 
a  cost-benefit  standpoint  only. 

Cost-beneficial  controls  are  controls  for  which  the 
benefits  can  be  shown  to  outweigh  the  costs  for  a  specific 
entity.   Both  costs  and  benefits  can  be  classified  as 
tangible  or  intangible,  current  or  future,  and  probabilistic 
or  deterministic.  Furthermore,  a  firm  is  a  coalition  of 
interests  to  which  the  interests  of  the  external  authority 
are  added  in  this  study.   This  adds  to  the  complication  by 
making  it  necessary  to  interpret  costs  and  benefits  in 
relation  to  whom  they  affect  in  order  to  understand  a 
particular  decision. 

Tangible  costs  are  easily  identified  and  enumerated. 
An  example  of  a  clearly  identified  tangible  cost  is  the  cost 
of  providing  computer  equipment.   Typically,  intangible 
costs  and  benefits  are  difficult  to  identify  or  evaluate. 
For  example,  the  added  strain  on  employees  when  a  procedure 
is  changed  is  an  intangible  cost. 

Current  costs  are  costs  to  be  incurred  in  the  immediate 
future.   For  example,  the  payroll  cost  of  an  internal  audit 
staff  is  a  current  cost.   Future  costs  will  be  incurred  far 
enough  in  the  future  for  the  time  value  of  money  to  become 
important.   An  example  of  future  costs  is  the  payments  on  a 
lease. 

Probabilistic  costs  are  costs  which  are  uncertain 
either  because  the  amount  is  uncertain  or  because  the 
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timing  of   the  expenditure   is   uncertain.      For  example,    the 

cost  of  business  missed  due  to  down-time  on  a  computer  is  a 

probabilistic   cost.      Deterministic  costs  are   certain  in 

either   amount   or   timing. 

Most  costs  and  benefits  are  a  mixture  of  future  or 

current,    tangible   or   intangible,    and  deterministic  or 

probabilistic.      It   is   relatively  easy   to  assess   costs  that 

are   current   or  future,    tangible,   and  deterministic.      Where 

the  time  value   of  money  is  known  fairly  accurately  and 

inflation  is  under   control,    a   comparison   between   cost  and 

benefits   can  easily  be  made   using  present  value   techniques. 

However,   when  future   costs  become   probabilistic  it   becomes 

difficult  to  even  estimate   the   expected  present  value  of 

future   costs  and   benefits.      When   costs  and   benefits  are   also 

intangible  as  well   as  future  and  probabilistic,    a  comparison 

becomes  more  of  an  art  form  than  a  science. 

Auditors'    Cost-Benefit    Techniques 

Fisher    [1978]    recognized  the  ambiguity  involved  in 

trying  to  detail   the  cost   of    implementing  an  internal 

control: 

The  cost  of  a  control  can  be  calculated  in 
various  ways:  absolute  total  cost  to 
implement  a  control;  marginal  or  incremental 
cost;  or  the  percentage  of  total  or  marginal 
cost  allocated  to  each  cause  of  an  exposure 
reduced  by  a  specific  control.  When  two  or 
more  controls  both  contribute  to  reduce  a 
cause  of  exposure,  one  needs  to  determine 
whether  they  are  complementary,  or  actually 
increase  assurance  when  used  together,  or  are 
substitutable.   [Fisher,  1978,  p.  355] 
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She  argued  that  the  benefit  of  a  control  can  be 
calculated  as  the  product  of  the  exposure,  a  percentage  of 
the  particular  cause  that  the  control  is  designed  to 
prevent,  and  the  effectiveness  of  the  control  measured  as  a 
percentage  [1978,  p.  355]. 

Rittenberg  and  Miner  [1979]  have  built  a  cost-benefit 
model  of  internal  controls  using  the  following  parameters: 
control  objectives,  number  of  transactions  processed  during 
a  period  of  time,  loss  associated  with  an  error  per 
transaction,  probability  of  an  error  in  an  uncontrolled 
environment,  reliability  of  controls  in  reducing  either  the 
probability  of  a  loss  or  the  probability  of  an  error,  cost 
of  controls,  and  nature  of  controls.   The  last  element  in 
the  list,  the  nature  of  controls,  refers  to  whether  the 
controls  are  sequential  (roughly,  the  only  control  for  an 
exposure)  or  parallel  (roughly,  a  redundant  or  compensating 
control).   There  are  strong  similarities  between  the 
complement/substitute  and  sequential/parallel  concepts. 

The  authors  measure  exposure  in  two  ways:  (1)  as  the 
product  of  the  loss,  the  number  of  transactions,  and  the 
probability  of  an  error;  and  (2)  as  the  product  of  the  loss, 
number  of  transactions,  probability  of  an  error,  and  one 
minus  the  reliability  of  the  control.   They  also  illustrate 
how  parallel  controls  can  be  combined  to  reduce  exposure. 
The  authors'  measure  of  the  benefit  of  a  control  is  the 
difference  in  the  two  measures  of  exposure.   They  compare 
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this  measure  of  benefit  with  the  cost  to  get  the  net  benefit 

of  the  control(s). 

Cushing  [1974]  applied  modeling  concepts  taken  from  the 

field  of  reliability  engineering  to  the  cost-benefit 

analysis  of  internal  control  procedures  and  systems.   He 

developed  a  series  of  models  of  increasing  complexity. 

Cushing's  basic  model  revolved  around  a  concept  of 

reliability  for  internal  control.   Reliability  was  used  as  a 

measure  of  the  probability  that  some  accounting  process, 

which  was  being  controlled,  would  be  completed  without 

error.   That  was  not  to  say  that  an  error  would  not  occur; 

rather,  once  completed,  the  process  would  be  error-free. 

Process  reliability  is  not  the  same  as  sampling  reliability 

in  auditing.  Cushing  computed  reliability  as  the  sum  of  the 

following  probabilities: 

(1)  the  probability  that  the  process  is 
executed  correctly  and  the  control  step  does 
not  signal  an  error;  (2)  the  probability  that 
the  process  is  executed  correctly,  the 
control  step  signals  an  error,  and  the 
failure  of  the  control  is  detected  and  no 
correction  is  made;  and  (3)  the  probability 
that  an  error  in  the  process  is  made,  but 
that  the  control  step  signals  an  error  and 
the  proper  correction  is  made.  [1974,  p.  26] 

Cushing  also  illustrated  a  procedure  to  compute  the 

probability  of  a  failure  to  complete  the  process  correctly. 

Based  on  these  formulations,  Cushing  showed  that  the  benefit 

of  a  control  is  the  increase  in  the  probability  that  the 

process  will  be  correctly  completed  caused  by  the  presence 

of  the  control  procedure. 
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Cushing  used  the  following  costs   in   computing   the   total 
cost   of   an  independent   control   associated  with  a  single 
potential    error: 

(1)  The   cost   of   performing  the  control 
procedure   each   time   the   process   is  performed. 

(2)  The   average   cost   of    searching  for   an 
error  and  detecting  whether   one  exists  once 
the  control   procedure  has   signalled  that  one 
exists,    and  then  making  whatever  corrections 
are    necessary. 

(3)  The  average   cost   of   an  uncorrected 
error.   (1974,   p.  27] 

The  total   cost,   assuming  the   control   step  is  performed, 
was   computed  as   the   sum   of   the  expected  costs   of   "(1) 
performance   of   the  control   step,    (2)    uncorrected  errors,    and 
(3)    search,    detection,    and   correction"    [1974,    p.    27].      The 
cost  of  nor  performing  a  control  step  was  defined  as  the 
probability  of  an  error   times   the  average   cost   of   an   error. 
Cushing  argued  that  a  cost-benefit  analysis  was  performed 
when  the  total  cost  was  compared  to  the  cost  of  not 
performing   the   control    step. 

The  work  reviewed  above  illustrates  how  cost-benefit 
analysis   can   be   operationalized.      But,    it   also   illustrates 
how  cost-benefit  analysis  becomes  increasingly  complex  as 
concepts   are  further   refined.      All   of   the  authors   described 
rules  for   cost-benefit  analysis.      They  specified  ways  of 
measuring  the  conditions  under  which   the   benefits  of   a 
control   outweighed  their  costs.      Fisher    [1978]    and 
Rittenberg  and  Miner    [1979]    also   stipulated   that   being  cost- 
beneficial    was   not  enough   to   insure  a   controls  acceptance. 
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The  company  as  a  whole  must   be  considered,   which  means 
allocating   resources   through   overall    capital   budgeting. 

Fisher    [1978,    p.    352]    has   delineated  some   criteria  for 
strategies   to  be  adopted  in   response   to  the  FCPA.      She 
stated  that   corporate   strategy   "should   be    systematic, 
defensible,    and  well-documented."     The   strategy  advocated  is 
an  appeal   to   consider   overall   corporate  objectives  and  the 
interaction  of   controls,    control   objectives,    and  control 
causes.      The   strategy   also   called  for    ranking   of    controls, 
in  a   cost-benefit  sense,   along  with   other   corporate 
projects.      In  other  words,    if   all   corporate   projects  whose 
benefits  exceed  their   costs  cannot   be  accepted,    then 
internal   controls   should   not    be  an  exception. 

Costs  and  Benefits  Accruing  to  Individuals  and  Groups 

Each  measure   of   cost-benefit   is   contingent  on  a 
particular   point   of   view.      There  are  numerous  points  of  view 
in  the  modern  firm:   they  include  management,    owners, 
creditors,    labor,    governmental   organizations,    and  external 
authorities. 

Management's  point   of   view.      Management  has  a   complex 
problem   in  analyzing  the   cost  and   benefits  of   a    decision. 
The  complexity  arises  because  management  benefits  from 
corporate  success  both  directly  in  terms   of  measures   of   job 
performance,    and  indirectly  in  terms  of  profit-sharing 
and  future  mobility.      Management's   decision   process   is 
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further  complicated  by  differences  in  long-term  and   short- 
run   notions  of   optimal    policies. 

Owner's   point   of   view.     The  owner's  point   of  view    is  to 
maximize  the  present  value  of   dividends  and/or   stock  prices 
in  the  long  run    (and  an  indirect   interest  in  minimizing 
payments  to  all   other   parties),    constrained   by  the    owner's 
need  to  maintain  appropriate   coalitions  in  the  long  run. 

Creditors'   point  of  view.     Rather    than  maximizing 
return  on  investment,    creditors'    interests  lie  in  meeting  a 
certain  level   of  achievement  while  minimizing   risk. 

Labor's   point   of   view.     The   classical    approach   is  to 
view  labor  and  owners  in  a  zero  sum  game  with  the  profits  of 
the  firm   as  the  objective.      However,    labor   takes  a   short-run 
approach  to  the   definition  of   the  firm's   profits    (as   is   to 
be  expected  from   individuals  whose   investment   is  a  day's 
labor  and  who  may  work   elsewhere  if  the  firm  cannot  pay 
labor's  wage).     This   short-run   approach   does  not   include 
growth  or  escalating  replacement  cost   of   plant  and 
equipment. 

Others'   point   of   view.      Government  and  others  have  many 
diverse  interests   in  the  firm.      Host,    like   labor's,    are 
short-run.     For   example,    governments  are  frequently  accused 
of   taking   the  expedient  route   of   correcting   social    ills   in 
the   short   run   at   the  long-run  expense   of   business. 

Auditors'   point   of   view.     External   auditors  have  an 
interest  that  partially  coincides  with  the  mutual   interests 
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of   owners,    creditors,    and  managers,   yet  partially  conflicts 
with   that   joint   interest.      The  mutuality  of   interest   comes 
in  reducing  the   cost   of   the  audit    by  having   the   client's 
internal  audit  staff  do  as  much  of  the  audit  as  possible 
(internal  audit   procedures  and   staff   are  assumed  to   cost   the 
client   less  than  external   audit  procedures  and  staff),    and 
by  having  the   client's   system   of   internal   controls    be   as 
effective  as  possible.      The  diversity   in  interest  arises 
when    (1)    the   cost   of    the  marginally  effective    control    is 
considered  too   great   by  the   client   but   not   so   by  the 
external  auditor,    or    (2)    the   cost   savings  from   the   internal 
auditors'    work   is  expected  to   be   shared  by   the  external 
audit  firm   and   the   client. 

Additional   non-monetary   interests  are  also  of 
considerable   importance.     An  example   is  management's 
expectation  that  the  external   auditor  will   find  weaknesses 
when  he  reviews  the  internal  control   system  and  will   report 
these   in  the  management  letter.      The  auditor,    on  the  other 
hand,   feels  the   need  to  meet  management's  expectations  and 
attempts  to  enumerate  weaknesses  even  if   they  are  not 
significant. 

Study's   point  of   view.      Clearly,    the   issue   of   to  whom 
the  cost  and  benefits  of  a  change  in  the  system  attach  must 
be   resolved  before  any  predictions  can   be  made   concerning 
the  directions  that  the  internal   audit   group  will   take  in 
response   to  criticism.      For   purposes  of   this   study,    the 
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mutuality  of  interests  among  the  management,    owners,    and 

creditors   will   be   considered  the  firm's   interest.      In 

effect,    the   study  adopts  the   owner's   point   of  view,    adapted 

so  as  to  minimize  conflicting  interest  with  other   interested 

parties.      This   is  achieved   by   selecting  and  wording 

scenarios  which  are  as  unambiguous  as  possible. 

External  Auditors'    Reliance   on   Internal   Auditors'    Work 

The  Round-Table   reported  that,   based  on  the  audit 

committee's  final   evaluation  of   internal   control,    internal 

audit  group,   and  external   auditors,    the  audit  committees 

were   seen  as  shifting  auditing   tasks   between  internal  and 

external    auditors. 

Internal   controls  determine   the  trade-offs 
between   risks  and  costs,    judgments  that  must 
be  made  by  the  audit  committee,    independent 
of   the  outside  auditor.      The   review   of 
internal   controls  could  lead  to  changes  in 
the   scope  and  focus   of   audits.      Then   the 
determination  must  be  made  whether  these 
modifications  are  to   be  assigned  to  inside   or 
outside    auditors.      [Schiff,   1977,   p.     26] 

Ward  and  Robertson    [1980]    surveyed  internal   and 
external    auditors.      The  results   indicated  that  all 
independent  auditors  relied  on   internal   auditors  to   some 
extent,    but   only  half   of   the  respondents   claimed  that  they 
relied  on  internal   auditors  as  much  as   possible.     This  was 
despite  the  fact  that  it  was  suggested  that  the  audit  costs 
could   be   decreased  or   the   rate   of   increase   in  audit   costs 
could  be   slowed  through  cooperative  audit  performance 
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between  the  internal   and  external   auditors.      Both 
independent  and  internal   auditors  agreed  that   the  extent   of 
the   external   auditors'    reliance   on   the   internal    auditors' 
work   should  be   increased. 

The   independent   auditors'    reliance   took  the  form   of   two 
major   areas:      the   internal   auditors'    contribution   to 
internal   control    and  the   internal   auditors'   "performance   of 
substantive  audit   procedures   under   the   supervision  of  and 
review   by   independent  auditors"    [Ward  and  Robertson,    1980, 
p.   64].      The  extent   of   the  efficiency  of    the    cost-savings 
depends   on    (1)    "Capabilities   of    the   internal    auditors",    and 
(2)    "   the   reliance   placed  on  their   work    by   the   independent 
auditors"    [Ward  and  Robertson,    1980,    p.    71].      Consistent 
with   this   evaluation  of   cost-savings,    "two  international 
accounting  firms  are  actively  promoting  professional 
training  programs  for   internal   auditors"    [Ward  and 
Robertson,    1980,    p.    71].      Therefore,    it  is  clear   that   some 
professionals  consider  a   shift  from  external   to  internal 
auditing  as   cost-beneficial    from   both   the  CPAs'   and  the 
clients'   points-of-view. 

Clay  and  Haskin    [1981]    provide  a  familiar  economic 

argument  in  favor   of   greater   reliance   by  external   auditors 

on  the  work  of    internal   auditors: 

If   procedures  performed   by  an  internal   audit 
staff   are  duplicated  during  the  year   or   at 
the  year-end   by  the  external   auditors,    the 
company  incurs  multiple  costs  for 
essentially   the   same   information.    [Clay  and 
Haskin,   1981,  p.  63] 
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Clay  and  Haskin  also  surveyed  100  internal  auditors 
(60%  response  rate)  to  gather  information  about  the 
competence,  objectivity,  value,  extent  of  external  auditor 
reliance,  and  cost  effectiveness  of  internal  auditors.   Clay 
and  Haskin  found  no  evidence  to  support  the  idea  that 
internal  auditors  were  cost-effective  in  reducing  external 
auditing  costs.   This  is  contradictory  to  what  Schiff  [1977] 
reported.   Therefore,  it  is  uncertain  whether  or  not 
benefits  from  reduced  external  auditing  costs  should  be 
considered  in  evaluating  a  change  in  internal  control. 

Auditors'  Abilities  to  Make  Internal  Control  Judgments 
Ashton  [1974a]  measured  judgment  stability  (within 
subject  consistency)  and  judgment  consensus  (between  subject 
consistency)  for  63  subjects  in  an  experimental  setting. 
The  experiment  consisted  of  asking  the  subjects  to  evaluate 
an  internal  control  setting  by  rating  the  control  on  a  six- 
point  scale.   Intra-subject  consistency  over  time  was  found 
to  be  quite  high.  Subject  consensus  was  measured  by  the 
correlation  among  subject  responses  for  the  same 
experimental  internal  control  variable  settings.   Consensus 
was  also  found  to  be  quite  high.  These  results  were 
confirmed  by  Ashton  [197  4b],  Ashton  and  Brown  [1980],  and 
Ashton  and  Kramer  [1980], 
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Joyce    [1976]    was  not  directly  concerned  with  auditors 
making  internal   control    judgments,    but  was  concerned  with 
auditors'   abilities  to  make    judgments.      Furthermore,    Joyce's 
study   was  a    response    to  Ashton's   study  which   used  auditors' 
abilities  to  evaluate   internal   controls  as  a  vehicle  to 
study    judgment  abilities.     The  criterion  used  to  measure 
judgment  ability  was   consensus    (agreement   among   judges)    [p. 
30].      The  reasons  given  for   the  selection  of   consensus  as  a 
measure  of   judgment  ability  were    (1)    if  experts  are 
measuring  the  same  thing,    no  matter  what  method  is  used, 
their   results   should  approach   each   other;     (2)    if 
professional   expertise  exists  among  auditors,    it   should  be 
exhibited   by   consensus    [pp.    30-31].      These   arguments   can   be 
considered  from   another   point   of   view.     Only   if   a  right 
answer  exists,    can  we  expect  expert   judgments  to   converge  on 
that  answer.      On  the  other   hand,    if   a   right  answer   exists 
only   through   convention  or   definition,    then   consensus  only 
measures  the  similarity  of   training  among  experts.      Joyce 
pointed  out  that  the  accounting  establishment   goes  to  pains 
to  reduce   differences  among  auditors    [p.    31],      He  reviewed  a 
series  of  articles  that  indicated  a  low   measure   of   consensus 
among  auditors.      The   only  exception  appeared  to  be  Ashton's 
1974   study    [pp.    31-4].      Joyce  hypothesized   that   the 
"differences   in  the  experimental   tasks   required  of   the 
subjects  could  account  for   the  apparent   discrepancy  between 
Ashton's   findings    and   those   of    the   others"    [p.    33]. 
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Basically,    this   difference   could   be  attributable  to  the  fact 
that  Ashton  asked  subjects  to  make  narrower,    more  technical, 
judgments  about  the  quality  of   internal   control,    while   the 
others  asked  for    judgments  on  broader   areas    (such   as  the 
amount  of  audit  work  that  would  be   done   under   given 
conditions)     [p.     33]. 

Like   Ashton' s   subjects,    Joyce's   subjects  had  to 
evaluate  internal   controls.     However,    they  had  to  make  a 
more  complex   judgment.     For   this  reason,   Joyce  expected  less 
consensus  among  his   subjects   than  was   the   case  for  Ashton's 
subjects.      His  results  were  as  expected.      In  other   words, 
the  consensus  among  Joyce's   subjects  was   consistent  with   the 
lower   levels  observed  by   researchers  before  Ashton. 

Lewis    [1980,    p.   594]   worked  from   the  presumption  that 
consensus   is  a  measure  of   the  validity  of  professional 
judgment.     Based  on  that   presumption  and  utility  theory,   he 
concluded  that   "auditors  would  have   to  possess  homogeneous 
utilities  for   the  outcomes  or   consequences  of   their 
decisions"    [1980,   p.   594],      Like   Joyce,    Lewis   pointed  out 
some  of   the  mechanisms  that  tend  to  create  homogeneity  among 
members  of   a  profession,    and  more  so  among  members  of  the 
same  firm.      He  performed  an  experiment  which  was   designed 
around  the  provisions  of  £AjS£  Statement  No.  5.,.  Accounting 
for  Contingencies,    to  test  whether   judgments  across  firms 
would  vary  more  than  judgments  within  firms.      Lewis  reported 
evidence   that  provided  mild  support  for   the   contention  that 
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there  was  less  difference  between  firms  than  within  firms 
[1980,  pp.  598-9].   He  also  varied  the  materiality  of  the 
data  the  subjects  were  given.   This  allowed  him  to  test 
whether  consensus  varied  with  materiality.   He  found  that  as 
materiality  increased  so  did  consensus  [1980,  p.  600]. 

It  is  the  relationship  between  materiality  and  consensus 
that  makes  the  Lewis  article  interesting.  The  direct 
relationship  between  consensus  and  materiality  indicates  that 
consensus  is  contingent  on  at  least  one  event.   Ashton 
found  more  consensus  in  simpler  decision  settings,  while 
Joyce  found  less  in  a  more  complex  setting.  A  major 
distinction  between  the  judgment  settings  may  be  thought  of 
as  the  additional  contingencies  encountered  in  the  more 
complex  setting. 

This  section  shows  that  the  literature  offers 
conflicting  evidence  on  the  degree  of  consensus  that  can  be 
expected  in  an  experimental  setting  similar  to  this  study. 

The  Differential  Impact  of  Source  Characteristics  on  the 
Internal  Auditor's  Decision 

The  concept  of  source  as  a  variable  affecting  the 

(auditor's)  confidence  in  a  received  message  is  well 

established,  even  codified.   Auditors  classify  evidence  by 

source.   They  consider  externally  generated,  third-party 

evidence  the  most  reliable.  At  the  same  time,  auditors  are 

taught,  from  their  first  auditing  class,  that  internally 

generated  documents  or  communications  should  be  confirmed. 
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In  other  words,   auditors  are  attuned  to   considering  the 
source   of   a  message   separately   from    its  content. 

In  this   particular   experimental    setting,   the   judges  are 
performing  auditing  or   auditing-like   functions.      Therefore, 
the   subjects   should   be   conscious  of   the   source-content 
distinction.      On  the  other   hand,    the   subjects'   awareness  of 
the   source-content   distinction   does  not  insure   that  a   change 
in  source  will   have  an  impact   on  their   decisions.     This  is 
especially  true   since  each   judge  was  exposed  to  only  one 
source.      Hence,    no   intra-subject   comparisons  were  possible. 

The  purpose  of  this  section  is  to  determine  if  a 
systematic  difference   in   response   for    the  two  sources, 
external   auditors  and   systems  analysts,    should   be  expected 
in  the  current   experiment.      This  is  not   to   say   that,    if  no 
difference   in   source   is  expected,    that   source  itself  will 
not  be   an  important  factor.      Rather,    source   may   still   be 
important,    but  the   source   systems  analysts  had  the   same 
impact  as  did  the   source  external   auditors.     There  are   two 
reasons  to  expect   no  difference   in  the  responses.      The  first 
is  the  possibility   that  source   could  have  an  insignificant 
weight  attached  to   it.      The   second   is   that   other  variables 
have   the  effect   of   negating  the   impact   of    source.     The  most 
important  of   these  compensating  variables  is   the  relative 
confidence   of   the    judge   in  his  opinion  compared  with  that 
of    the    source. 
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Experimental   psychologists   classify   those  attributes  of 

a  communicator   which   influence   the   receiver's  attitude  about 

a  message's   content  as   source    characteristics.      There   is    (as 

yet)   no   generally  accepted  measurement   scale  for   source 

characteristics,  theoretical  constructs  adopted  by 

researchers.   Therefore,  each  researcher  has  selected  his 

own  system  of  measurement.  So,  while  generalizations  may  be 

made  within  groups  studied  using  a  set  of  source 

characteristics,  no  comparisons  can  be  made  between  studies 

using  different  source  characteristics.   In  particular, 

difficulties  arise  when  overlapping  source  characteristics 

are  used  in  research.   For  example,  the  characteristic  of 

source  credibility  has  been  decomposed  into  expertise  and 

bias  by  some  researchers  [Eirnbaum  and  Stegner,  1979],  while 

others  have  decomposed  source  credibility  into  expertise  and 

trustworthiness  [Haas,  1981].  The  concepts  of  bias  and 

trustworthiness  overlap  but  are  not  the  same.  Other 

problems  arise  because  of  research  methodology.  Jaccard 

says  that 

persuasive  messages  in  the  experimental 
literature  are  composed   of   a   set   of   belief 
statements    (i.e.    information)    and  hence   are 
designed  to   change   beliefs.      When  an 
investigator   uses  affect,    behavioral 
intention,    or   behavior   as   the   dependent 
measure,    he  or   she  is  implicitly  assuming 
that   changes  in  these   target   beliefs  will 
lead  to  changes  in  the  dependent   measure    (an 
assumption    that   may    be    incorrect).      [1981,   p.   261] 

Haas    [1981]   provides  a  useful   framework  for  examining 

source   characteristics.      Some   of   the   details   of   his 
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framework   are   useful   to  this   discussion.     For  example,   he 
describes  two  mechanisms  by  which  a  message  could  produce  an 
attitude   change.      The   first   is    called   internalization. 
"Internalization  occurs  when  an  attitude   is  learned  and 
adopted  as   the   receiver's  own   by  being  integrated   into   that 
individual's   belief    and  value    system"    [1981,    p.    142].      Haas 
uses  credibility  as  an  example   of   a   source   characteristic 
that  is  thought  to  work  through   internalization.      The   second 
mechanism   is   called  identification.     Identification  is  a 
"desire   to  establish   a  gratifying  role  relationship  with   the 
source"    [1981,    p.    144].      Haas's  example    of   a    source 
characteristic  that  works   through  identification  is 
attractiveness.      In   general  Haas's   framework  has   three  major 
source   characteristics:    credibility,    attractiveness,    and 
power. 

Source   credibility   is   "the  extent   to  which   the   source 
is  perceived  to   know   the   'correct'    position  on   the   issue  and 
the  extent  to  which  he  or   she  is  motivated  to  communicate 
that   position"    [1981,    p.    142].      Source   attractiveness 
depends   on  the   source   being  someone   liked  or   admired.      It   is 
thought  that  association  or   emulation   of    someone   liked   or 
admired  will   improve  the  self-image   or   self-esteem  of  a 
communication-receiver.     Therefore,    a  receiver  might  adopt 
the  same  attitude  as  a  source  he  admires;  or  he  might  hold 
an  attitude   that   supplements   the  attitude   of   the   source, 
when  the  source  and  receiver  have  complementary  roles 
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(teacher-student)    [1981,    p.   144].      Source  attractiveness  may 
be  more  influential    than  source   credibility  because   source 
credibility   could  depend  on  the   soundness  of   the 
communication,    while  attractiveness  is  independent  of   the 
logical   content   of   the  message    [1981,    p.    144-45]. 

Source   credibility  and  attractiveness  may  seem 
independent  at  first,   but   closer   examination  reveals  an 
overlap.      A  source   may  be  attractive  because  he  is 
credible.     When  an  authority  speaks  of   a   subject  on  which 
he  is  not  an  authority,   the   tendency   is  to  treat  him   as 
attractive   because   of   his    credibility  on   other    subjects. 
Therefore,   credibility  and  attractiveness  may   interact   or 
overlap. 

The  third  characteristic  in  the  framework  is  power  of 
the   source.      If   the   source  has   the  ability  to  exercise   power 
over   the  receiver,    the   recipient  may  comply  with   the   source's 
communication    [Haas,    1981,   pp.    149-51], 

In  the  current   study,    the   source   is  either   an  external 
auditor   or   a   systems  analyst.      Both  have   sufficient 
expertise   to  be   considered  credible   sources,    if    they  are 
perceived  to  have   the   proper  motivation    (trustworthy  or 
unbiased) . 

Nothing  definitive  can  be   said  about   the  attractiveness 
of   external   auditors    (or    systems  analysts)    to   internal 
auditors.     An  equal   number   of   arguments   can  be   put   forth 
considering  whether  internal  auditors  would  find  external 
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auditors  attractive.      The   best   of    these   arguments, 
identification  through   similarity,   can  be   argued  in  either 
direction. 

There  is  a   clear  distinction  between  the  power 
relationship  for   internal-external   auditors  and  internal 
auditors  and  systems  analysts.      The  external   auditor  has  a 
professional  obligation  to  exercise  a   certain  amount   of 
power   over   the  internal   auditor.      That  power   is  derived  from 
the  terms  of  engagement  combined  with  the  fact  that   the 
auditor  will    issue  an  opinion.     The   systems  analyst   offers  a 
report,    but  it  is  for  internal   use   only.      Even  after   the 
systems  analyst   is  engaged,    his  power   is  strictly  limited  to 
internal   use.      Thus,    it  would  appear   that   the   two    sources, 
systems  analyst  and  external   auditor,    should  be   different   on 
the  power  dimension.      However,    because  it  was  felt  that   such 
use   of   power   would  obscure   the  other  factors  being  examined, 
the  external  auditors'   recommendations  were   carefully 
designed  to  avoid  the  naked  use   of   power.      Therefore,    it   is 
unclear  if  any  distinction   can  be  made   between  the   power   of 
the  analyst  and  the  external   auditor   along  the  power 
dimension. 

Even  if   one   of   the   source   characteristics  were  capable 
of   being  well-measured  in  the  experiment,   another  problem 
would  make   testing  difficult.     Jaccard  found  that   "whenever 
people  are  more   confident   in   themselves   than   the   source, 
relatively    little   belief    change   results"    [1981,    p.    266]. 
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This  has  significant   implications  for   relations   among 
"experts."     By  definition,    an  expert   should  be   confident   in 
his  own   conclusions.      Therefore,    it   is  reasonable  to  assume 
that   there   should  be   no   difference  between  sources  when  the 
recipient  is  an  expert,    as   is   the   case  in  the   current 
experiment.      Professional    judgment  is  assumed  to  be   strongly 
dependent  on  the   circumstances   of    the   decision.     The  model 
will    represent   professional    judgment  as  various  types  of 
changes   being   recommended.     Figure   2-1    illustrates   the 
decision  process.      However,    the   experimenter   and  the   subject 
may  not  agree  on  the  classification  of  the  type  of  change 
being   recommended.     Therefore,   provisions  have   been  made   in 
the  design  of   the  experiment  to  measure   not  only   the   effects 
of   the  intended  manipulations  of   the  independent  variables, 
but  also  the  effects  of  manipulations  with   respect   to  the 
subjects'   perceptions. 
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Figure  2-1.  General  Model  of  Factors  Influencing  Internal 
Auditors'  Responses  to  External  Criticism  of  the  System  of 
Internal   Controls 

This   section  suggests  that  the  impact  of   the  two 

sources,    systems  analysts  and  external   auditors,   will   not   be 

different.      However,    this   is  not  to  be   construed  to  mean 

that   source  will   not  be   a  meaningful   factor   influencing 

decision. 


CHAPTER  III 
RESEARCH  METHODS 

The  purpose  of  this  chapter  is  to  describe  the  general 
model  of  corporate  behavior  used  as  a  basis  for  this 
experiment,  the  experimental  design  and  task,  the  subjects, 
the  hypotheses,  the  pilot  testing  procedures,  and  the  final 
design. 

Model  of  Corporate  Behavior 

It  was  indicated  in  the  literature  review  that  the 
current  trend  in  the  organization  of  the  corporate  internal 
control  hierarchy  is  directed  toward  the  use  of  largely 
independent  audit  committees.   It  was  also  suggested  that 
internal  control  departments  must  frequently  review 
suggestions  for  changes  in  the  system  of  internal  controls. 

In  this  study,  the  internal  auditor  is  used  as  a 
surrogate  for  the  corporate  audit  committee.   As  a  result, 
the  corporate  model  of  behavior  becomes  a  model  of  the 
internal  auditor's  behavior.   Because  this  study  focuses  on 
the  response  to  externally  generated  suggestions  for  changes 
in  the  system  of  internal  control,  the  proposed  model  of  the 
internal  auditor's  behavior  consists  of  the  expected  modes 
of  response  to  that  particular  stimulus. 
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The  influence  of  an  external  authority  is  assumed  to 

affect  the  internal  auditor's  opinions  as  well  as  his  own 

evaluation  of  the  merits  of  the  suggested  change.   Since  no 

direct  measures  of  the  degree  of  an  external  authority's 

influence  are  availabler  the  source  and  tone  of  the  external 

authority's  criticism  have  been  adopted  as  surrogates.   The 

source  and  tone  of  a  message  may  only  serve  to  direct 

attention  to  a  problem,  which  will  then  be  considered  on  its 

own  merits.  On  the  other  hand,  internal  auditors  may  be 

more  influenced  by  the  prestige  and  power  of  external 

authorities.   Internal  auditors  may  respond  to  the  influence 

exerted  on  them  by  external  authorities  in  many  different 

ways.   Furthermore,  the  nature  of  their  responses  should  be 

heavily  influenced  by  their  own  professional  judgment.   In 

the  model  proposed,  professional  judgment  is  assumed  to  be  a 

function  of  the  complexity  of  the  choice  before  the  internal 

auditor.  The  more  complex  the  choices  available  to  the 

internal  auditor,  the  more  he  will  rely  on  his  professional 

judgment.  However,  the  more  ambiguous  the  decision,  the 

more  he  will  rely  on  other  factors,  such  as  the  source  and 

tone  of  the  criticism,  to  make  his  decision.   This  argument 

is  formalized  in  the  first  hypothesis,  which  is  presented 

below.   All  hypotheses  are  restated  in  the  chapter  summary. 

Hi:   The  more  ambiguous  the  decision,  the  greater  the  subject's 
reliance  on  the  source  and  tone  of  the  message. 
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Experimental  Design 
The  experimental  design  is  described  in  terms  of 
scenarios,  independent  variables,  dependent  variables,  other 
responses,  and  assignment  of  variable  combinations  to 
subjects.   There  were  forty-eight  scenarios,  four 
independent  variables,  eight  dependent  variables  and  ten 
other  responses. 
Scenarios 

The  experimental  instrument  consisted  of  a  package 
containing  (1)  two  pages  of  instructions  (see  Appendix  A), 
(2)  eight  to  ten  pages  containing  four  scenarios  (see 
Appendix  B) ,  and  (3)  two  pages  of  additional  questions  (see 
Appendix  C).   The  instructions  contained  a  brief  description 
of  (1)  the  assumptions  the  subject  was  to  make,  (2)  the 
subject's  task,  (3)  the  confidential  nature  of  his  response, 

(4)  the  absence  of  any  time  limit  imposed  on  the  task,  and 

(5)  a  corporate  structure.   Each  subject  was  to  respond  to 
four  scenarios,  each  of  which  was  based  on  the  same 
corporate  structure;  the  corporate  structure  was  described 
as  being  common  to  four  companies:  Alpha,  Beta,  Gamma,  and 
Delta.   The  four  companies  represented  the  four  scenarios 
included  in  that  subject's  package. 


43 

There  was  a  brief  description  of  the  corporate 
structure  of  the  company  for  which  the  subject  was  assumed 
to  work  and  for  which  the  external  source  (external  auditor 
or  systems  analyst)  had  suggested  a  change  in  internal 
controls  in  the  scenario. 

Each  scenario  described  a  different  internal  control 
procedure  which  was  associated  with  a  particular  type  of 
control  (see  the  independent  variable  "type  of  control"). 
After  the  initial  description  subjects  were  asked  to  rate 
the  strength  of  the  internal  control  procedure  and  to  rate 
the  overall  importance  of  an  internal  control  procedure  of 
the  type  described  (see  the  descriptions  of  the  dependent 
variables).   The  scenario  then  described  the  recommendation 
that  was  being  made  (see  the  independent  variable  "type  of 
change")  and  the  tone  of  the  recommendation  (see  the 
independent  variable  "tone").   Next,  the  task  required 
five  more  responses,  numbers  3  through  7:  (3)  assuming  the 
change  is  implemented,  rate  the  strength  of  the  internal 
control  procedure;  (4)  classify  the  type  of  change;  (5) 
allocate  100  points  to  the  reasons  for  the  subject's 
decision  concerning  the  internal  control  change;  (6)  rate 
the  impact  of  the  change  on  the  overall  system  of  internal 
control;  and  (7)  recommend  a  course  of  action  to  the  audit 
committee.   For  a  more  complete  discussion  of  each  of  the 
responses,  see  the  section  describing  dependent  variables. 
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The  detailed  scenarios  are  included  in  Appendix  B.   The 
forty-eight  (3x4x2x2)  scenarios  consisted  of  the 
combinations  of  the  various  levels  of  the  following 
independent  variables:  type  of  control  (3  levels),  type  of 
recommended  change  (4  levels),  source  (2  levels),  and  tone 
(2  levels). 
Independent  Variables 

There  are  four  independent  variables:  (1)  type 
of  control,  (2)  type  of  change,  (3)  source  of  criticism, 
and  (4)  tone  of  criticism. 

Type  of  controls.  Three  types  of  internal  control 
areas  were  selected  from  a  comprehensive  survey  of  EDP- 
related  internal  controls  performed  by  the  Stanford  Research 
Institute.   Of  the  six  control  areas  discussed,  three  were 
selected:  transaction  origination,  (T);  data  processing 
transaction  entry,  (Eh  and  computer  processing,  (P) 
[Russell,  Eason,  and  Fitzgerald,  1977].   However,  due  to  the 
nature  of  the  scenarios,  which  had  to  be  written  around  a 
particular  control,  the  three  types  of  controls  were  not 
varied  systematically  with  respect  to  the  other  independent 
variables.   In  other  words,  while  it  was  possible  to  combine 
an  E-type  of  control  with  each  of  the  other  independent 
variables,  it  was  not  possible  to  combine  the  same  E-type  of 
control  with  each  of  the  other  independent  variables.  As  a 
result  the  type  of  control  variable  was  confounded  with  the 
scenario  in  which  it  was  described.   While  this  prevents  the 
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study  from  determining  anything  about  the   three   types   of 
controls   individually,    it  does  provide   a   convenient  way  to 
characterize   the   combination   of   control   type   and   scenario. 

■ma  nf   ctonaa.     Four    types  of   changes  were  varied 
systematically  across   the   other    independent  variables. 
Controls  were  classified  by  the  researcher   as  complements  or 
substitutes.      Complement  controls  were  designed  into  an 
internal   control    setting  such   that,    if   they  were  added  or 
deleted,    they  would  have  a   significant   impact  on  the 
reliability   of   the   system.     Substitute   controls  were 
designed  such  that  their   presence   or   absence  would  not  have 
a   significant   impact   on  the  reliability   of   the   system.     The 
definition  of   substitute  and  complement  led  to   the 
organization  of   the  controls  in  a  two-by-two  table,    shown  in 
Figure    3-1. 


Control 
Added 


Control 
Deleted 


Complement 
Substitute 


cell  a 


cell  c 


cell  b 


cell  d 


Figure  3-1.   Possible  Combinations  of  Adding  and  Deleting  a 
Substitute  or  Complement  Control 

Cell  c  (addition  of  a  substitute)  was  eliminated  from 
consideration  because,  by  definition,  it  would  have  the  same 
impact  as  cell  d  (deletion  of  a  substitute).   By  contrast, 
cell  a  (addition  of  a  complement)  would  enhance  the 
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reliability  of   the   system,   while   cell   b    (deletion  of   a 
complement)    would  have  a  worsening  effect.      The  latter   three 
types   of   changes  were   arbitrarily  labeled:    type-1    (cell    a, 
add  a   complement),   type-2    (cell   b,    delete  a   complement),   and 
type-3    (cell   d,    delete  a   substitute).      A  fourth   type    of 
change,   type-4,   was   included  as  a  measure  of   consistency 
within  subjects.     Type-4,    the   replacement   of  a   substitute 
with  a  complement,    should  have  the  same  impact  as  adding  a 
complement    (type-1)   because   the   deletion  of  a   substitute 
should  have  only  a  small  effect  on  internal  control 
reliability  while  adding  a  complement  is  an  enhancement.      A 
review   of   the   types  of   changes  and  their  expected  impact  on 
the   reliability  of   internal   control   is  presented  in  Table  3- 

1. 

Table  3-1.   Expected  Effects  of  Change  Types  on  Internal 
Control  Reliability 


Change 
Type 


Expected  Impact  on 
Internal  Control 
Inscription  Reliability 


Type-1    add  a  complement  increase 

Type-2    delete  a  complement  decrease 

Type-3    delete  a  substitute  none 

Type-4  replace  a   substitute  with  increase 

a   complement 

The   researcher's   classification  of    controls  as 
substitutes  or   complements  was  subjected  to  testing  in  pilot 
test    situations.      Substantial    revisions  of   the   scenarios 
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were  made  as  a  result  of  these  pilot  tests.  The  details  are 
reported  in  Appendix  E:  Pre-testing. 

Each  subject  was  asked  to  respond  four  times,  once  for 
each  type  of  change.  Subjects  were  randomly  assigned  to 
various  combinations  of  types  of  controls  and  types  of 
change  as  well  as  to  combinations  of  the  other  independent 
variables.  The  details  of  this  assignment  will  be  presented 
following  the  description  of  the  independent  variables. 

Source.  The  main  concern  of  the  experiment  was  to 
measure  the  internal  auditors'  responses  to  criticism  from 
external  auditors.   However,  in  order  to  provide  a 
standard  against  which  to  compare  responses,  half  of  the 
subjects  were  presented  with  recommendations  from  systems 
analysts  instead  of  external  auditors.   The  distinction 
between  the  sources  of  the  recommendations  was  made  in  the 
instructions  attached  to  the  experimental  instrument  (see 
Appendix  A:  Instructions  For  Subjects).   The  subjects 
received  one  of  two  sets  of  instructions,  which  included  a 
request  that  the  subjects  make  some  assumptions.   The 
external  auditor  type  of  instruction  read 

3.  The  company's  external  auditors  have  recently 
submitted  a  management  letter  at  the 
completion  of  their  audit. 

4.  The  management  letter  includes  a  recommended 
change  in  the  internal  control  system,  which 
has  been  included  under  the  heading  of 
"EXTERNAL  AUDITOR'S  RECOMMENDATION." 
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The  systems  analyst  type  of  instruction  read 

3.  The  organizational  design  requires  that  you 
report  directly  to  the  board  of  directors' 
audit  committee. 

4.  Each  year  the  controller,  who  reports  to  the 
company  president,  employs  an  outside  systems 
analyst  to  review  the  system  of  internal 
controls.   The  most  recent  analyst's  report 
includes  a  recommended  change  in  the  internal 
control  system,  which  has  been  included  under 
the  heading  of  "SYSTEMS  ANALYST'S 
RECOMMENDATION." 

The  only  other  differences  between  the  two  versions  of 

the  experimental  instruments  were  the  differences  in  the 

headings.   The  two  versions  are  included  in  Appendix  B: 

Scenarios.   A  review  of  the  literature  in  Chapter  II 

indicated  that  no  difference  should  be  expected  between  the 

amount  of  reliance  the  subjects  place  on  the  source  of  the 

criticism  for  either  external  auditors  or  systems  analysts. 

This  expectation  is  the  basis  for  hypothesis  two,  which 

would  be  desirable  to  support. 

H2:   There  is  no  difference  between  the  amount  of  reliance 

subjects  place  on  the  source  (either  external  auditors  or 
systems  analysts)  of  the  criticism. 

Tone.  The  experiment  was  also  concerned  with  the 
effect  of  the  tone  of  the  external  authority's 
recommendation  on  the  internal  auditor's  response. 
Therefore,  two  levels  of  tone,  or  strength  of 
recommendation,  were  used.   The  measure  of  tone  used  was 
made  relative  to  prior  years'  recommendations.   For  each 
type  of  change,  subjects  were  told: 
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Note:  The  external  auditor  views  this  change  as 
relatively  l£s_g  critical  than  changes  recommended 
in  prior  years. 

In  total  there  were  four  levels  of  source  and  tone 

combinations  as  illustrated  in  Figure  3-2. 


Source 
Levels 


External 
Auditor 


Systems 
Analyst 


Tone  Levels 

Less      More 
Critical  Critical 


Figure  3-2.   Four  Combinations  of  Source  and  Tone. 


Each  subject  was  assigned  four  scenarios,  all  of  which 
were  either  systems  analyst  scenarios  or  external  auditor 
scenarios.   In  either  case,  a  subject  was  assigned  two 
"less"  critical  and  two  "more"  critical  scenarios.   The  four 
scenarios  assigned  to  a  subject  were  each  a  different  type 
of  change,  and  all  three  different  types  of  controls  were 
represented  in  each  subject's  package  of  four  scenarios. 

Assignment  of  subjects  to  treatments.   In  order  to 
assign  a  reasonably  small  number  of  treatments  to  each 
subject  and  still  be  reasonably  certain  that  the  response 
rate  would  be  fairly  even  among  all  cells,  particular 
combinations  of  independent  variables  were  devised.  All 


together   there  were  48  combinations   of   the  four   independent 
variables:    type   of   control   x  type   of   change   x  source   x  tone 
=  3  x  4  x  2  x  2  =  48.      It  was  decided  that  each  subject 
could  respond  to  four   scenarios  within  a   reasonable  time   (as 
was   shown  in  the   pilot   tests). 

The  following  additional   constraints  were  also  placed 
on  the  assignment   of   scenarios  into  four   scenario  packages: 
(1)    each   package  must   contain  one  each   of   the  four   types  of 
changes;    (2)    each   package  must   contain  each   of   the    three 
types  of   controls;    (3)    each  package  must   contain  both  levels 
of  tone;    and    (4)    the   order   of   the   scenarios   in  each   package 
must  not  be  the  same  as  to  type  of  change,   type  of  control, 
or   tone.     As  a  result,    scenarios  were   combined  in  the   six 
packages  described  in  Table  3-2.     There  were  twelve 
different   packages   in  all,    six  for   external  auditors  and  si 
for    systems  analysts. 


x 
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Table  3-2.      Packages   of   Scenarios. 


Package 

Type 

of 

Type  of 

Number 

Control 

Change 

Tone 

1 

T 

1 

s 

E 

3 

w 

P 

4 

w 

T 

2 

s 

2 

E 

2 

s 

T 

3 

w 

P 

4 

s 

E 

1 

w 

3 

E 

2 

w 

T 

1 

w 

P 

3 

s 

T 

4 

s 

4 

E 

3 

s 

T 

2 

w 

P 

1 

E 

E 

4 

W 

5 

T 

4 

W 

P 

3 

w 

E 

1 

s 

P 

2 

s 

6 

P 

1 

W 

E 

4 

s 

T 

3 

s 

P 

2 

w 

Key  to  symbols  used  in  table: 
Type  of  Control 

T    Transaction  Origination 
E    Transaction  Entry 
P    EDP  Processing 
Type  of  Change 

1  Add  a  Complemenet 

2  Delete  a  Complement 

3  Delete  a  Substitute 

4  Replace  a  Substitute  with  a 
Complement 


Tone 


More  Critical  Than  Last  Year 

(Strong) 

Less  Critical  Than  Last  Year  (Weak) 
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Dependent  Variables 

Each  subject  was  asked  to  make  seven  responses  for  each 
of  the  four  scenarios  under  his  consideration.   Those 
responses  are  seven  of  the  eight  dependent  variables:  (1) 
internal  control  strength-bef ore,  (2)  procedure  importance, 
(3)  internal  control  strength-after,  (4)  classification  of 
change,  (5)  allocation  of  points,  (6)  impact  of  change,  and 
(7)  recommendation.   The  eighth  dependent  variable, 
difference,  is  the  signed  change  in  the  after  minus  before 
ratings  of  internal  control  strength  [(3)  -  (1)]. 

Internal  control  strenath-before.   Subjects  were  asked 
to  rate  the  strength  of  the  internal  control  procedure 
described  in  the  scenario  immediately  after  the  procedure  was 
described  and  before  the  external  authority's  change  was 
presented.   Their  responses  were  recorded  on  a  nine-point 
scale  which  ranged  from  very  weak  (-4)  through  adequate  (0) 
to  very  strong  (+4). 

Procedure  importance.  The  second  question  asked  the 
subject  to  rate  the  importance  of  having  an  adequate 
internal  control  procedure  designed  to  protect  the  area 
under  consideration.  The  subject  was  to  respond  without 
reference  to  the  particular  internal  control  procedure 
mentioned  in  the  scenario.   Therefore,  this  question  was 
designed  to  measure  the  importance  of  the  weakness 
indicated,  not  the  importance  of  a  particular  solution.   In 
this  way,  it  was  possible  to  have  a  response  in  which  a 
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subject  stated  that  a  control  increased  the  strength  of  the 
particular  internal  control  procedure,  combined  with  a 
response  that  the  overall  internal  control  did  not  improve 
very  much.   The  subjects  responded  on  a  five-point  scale 
which  ranged  from  not  very  important  (0)  to  very  important 
(+4). 

Internal  control  strength-after.  Subjects  were  asked 
to  rate  the  strength  of  the  internal  control  procedure 
described  in  the  scenario  immediately  after  the  external 
authority's  change  and  tone  were  presented.   Their  responses 
were  recorded  on  a  nine-point  scale  which  was  identical  to  the 
scale  used  in  the  internal  control  rating  before  the  change. 

Difference.  To  measure  the  impact  of  the  changes 
presented,  the  difference  in  the  before  and  after  internal 
control  ratings  (after  -  before)  were  computed.   Also,  the 
difference  was  used  to  reclassify  the  responses  in 
accordance  with  subjects'  perceptions  (rather  than  the 
author's)  into  three  categories:  (1)  increased  internal 
control,  (2)  decreased  internal  control,  and  (3)  unchanged 
internal  control.   Table  3-3  indicates  the  relationship 
among  the  subjects'  perceived  changes  and  the  intended 
(author's)  manipulations  of  type  of  change. 
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Table  3-3.   Relationship  Between  Expected  Subject  Perception 
and  Corresponding  Manipulation  of  Internal  Control  Change 


Difference 
in  Internal 
control  Ratings 

increase 


decrease 
none 


Corresponding 
Type  of  Internal 
Control  Change 

add  a  complement,  or 
replace  a  substitute 
with  a  complement 

delete  a  complement 

delete  a  substitute 


Type  of 

Change 

Number 

1  or  4 


Classification  of  Change.  Subjects  were  asked  to 

classify  the  changes  recommended  to  them  by  an  external 

source.   Rather  than  explain  the  concepts  of  substitute 

and  complement  in  the  directions,  subjects  were  asked  to 

classify  changes  as  desirable  or  undesirable.   The  cover 

sheet  instructions  included  the  following  note: 

Each  change  involves  one  or  two  controls. 
Controls  can  be  loosely  classified  into  two 
groups: 

(a)  desirable  controls-  those  controls  that 
correct  a  weakness  in  the  internal  control 
procedure,  and 

(b)  undesirable  controls-  those  controls  that 
fail  to  correct  a  weakness  in  the  internal  control 
procedure,  including  redundant  controls. 

You  will  be  asked  to  classify  each  change  as  one 
of  the  following: 

a.  addition  of  a  desirable  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  a  desirable  control 

d.  deletion  of  an  undesirable  control 

e.  a  simultaneous  deletion  of  an  undesirable 
control  and  the  addition  of  an  undesirable 
control 

f.  a  simultaneous  deletion  of  an  undesirable 
control  and  the  addition  of  a  desirable 
control 
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This  subject  response   provided  an  opportunity  to  verify 
the   subject's  internal    control    rating  with  his  perception  of 
the   type   of   change   recommended.     Even   if   the   subject 
classified  the  change   incorrectly,    there  are  a   set  of 
expectations   for    the    dependent   variable    "difference."     These 
expectations  are  detailed   in  Table  3-4.      This  concept 
suggests   the   third  hypothesis:    the   change   in   the   internal 
control    ratings   will   be  a   function  of   the  subject's 
classification  of   the   type   of   change,    as   is   specified   in 
Table  3-4. 


Table   3-4.      Possible  Subject   Perceptions  and  the 
Corresponding  Values   of   Difference 


Subject 
Response 

Correspc 
Type  of 

nding 
Chanae 

Corresponding  Eating 
Difference 

a 

1 

increase 

b 

none 

none 

c 

2 

decrease 

d 

3 

none 

e 

none 

none 

f 

4 

increase 

Allocate 

Dn  of  points.   Each 

subject  was  asked  to 

allocate  one  hundred  points  to   the  factors  which  would 
influence  his  recommendation-to-the-audit-committee 
decision.      The   subjects  were   given  four   categories  for 
allocating  their   points.      Three  of   the  categories  were  pre- 
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specified:    (1)    source   of   the   recommendation,    (2)   tone    of    the 
recommendation,    and    (3)    the  subject's  assessment   of   the 
economic  cost-benefit   impact   of   the   change   on   the   company. 
The   fourth   option   was   to  assign   points  to  "other"  factors. 
Subjects  were  reminded  that  the  points  allocated  must  sum   to 
100. 

Impact   of   change.     Subjects  were  asked  to  rate   the 
effect  that  the   proposed  change  would  have  on  the  quality  of 
the  overall   system   of    internal   controls.     They   were  given  a 
nine-point  scale  ranging  from   greatly  reduce  internal 
control    (-4),    through   internal    control    unaffected    (0),    to 
greatly   improve  internal   control    (  +  4).      It  was  thought   that 
this   response  would  capture  the  combination  of   the 
importance  of   the   change  to  the   particular   internal   control 
procedure  and  the   importance   of   the  internal   control 
procedure    itself. 

Recommendation.     Subjects  were  asked  to  rate   the 
strength  of   their  suggestions  to   the  audit   committee  about 
the  proposed  change   on  a   nine-point   scale  ranging  from 
strongly  recommend  rejection   (-4)   to   strongly   recommend 
acceptance    (+4). 
Other  Responses 

Each   subject   was  asked  to  provide   additional  data  about 
himself  after   the   task    (completing  responses  to  four 
scenarios).      In  all,    there  were   ten   "other"  questions.      The 
first  three  were  intended  to  measure   the   subject's 
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involvement  in  his   task.      The   next    six    "other"  questions   asked 
for   demographic  data  about   the   subject.      The  last  question 
related  to   the  experimental    task.      The   ten  questions  are 
described   in  Appendix  D. 

The  Role  of  the  Independent  and  Dependent  Variables  in  the 
Overall  Decision  Model 

The  general  decision  model  presented  earlier  as  Figure 

2-1  was  implemented  in  the  experimental  design  as  a  function 

of  independent  and  dependent  variables.   The  outside 

authority's  influence  on  the  decision  process,  which  was 

implemented  as  the  source  and  the  tone  of  outside  criticism, 

is  represented  by  using  the  independent  variable  to  obtain 

the  independent  variables  source  and  tone.   The  type  of 

criticism  is  represented  as  the  independent  variable  type  of 

change.   The  decision  process  is  represented  by  two 

dependent  variables,  the  importance  of  the  internal  control 

procedure  and  the  internal  auditor's  recommendation  to  the 

audit  committee.   The  model  assumes  that  the  internal 

auditor's  decision  is  a  function  of  the  importance  of  the 

internal  control  procedure.   The  assumed  decision  process  is 

illustrated  in  Figure  3-3. 
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Figure  3-3.  Decision  Model  of  Factors  Influencing  Internal 
Auditor's  Response  to  External  Criticism  of  the  System  of 
Internal  Control 


The  effectiveness  of  the  decision  model  presented  in 
Figure  3-3  depends  on  the  concurrence  of  the  experimental 
design  and  the  subjects'  perceptions  of  the  design.   In 
other  words,  the  investigator  may  have  intended  a  scenario 
to  signal  that  the  addition  of  a  complement  is  strongly 
suggested  by  an  external  auditor.  However,  the  subject  may 
have  perceived  a  signal  that  was  the  addition  of  a 
substitute,  weakly  suggested  by  an  external  auditor.   This 
problem  may  be  addressed  in  two  ways.  First,  it  could  be 
assumed  that  there  were  no  systematic  differences  between 
intended  manipulations  and  perceived  manipulations  so  that 
any  errors  would  be  averaged  out  by  randomness.  Second,  the 
model  could  be  redefined,  based  on  the  subjects'  revealed 
perceptions.   The  second  approach  was  adopted  so  that  the 
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two  alternate  models  (intended  manipulation  versus  perceived 
manipulation)  could  be  compared.  The  comparison  of  the 
models  would  indicate  the  existence  of  a  systematic  bias. 
Furthermore,  because  interest  is  focused  on  the  internal 
auditors'  reactions,  rather  than  the  ability  to  manipulate 
independent  variables,  the  internal  auditors'  perceptions  of 
the  independent  variable  manipulations  should  be  a  preferred 
measure.  Also,  using  both  models  simultaneously  provides  a 
measure  of  achieved  success  in  the  intended  manipulations  of 
the  variables. 

The  revised  decision  model,  which  depends  on  the 
subjects'  perceptions,  requires  the  substitution  of 
intermediate  dependent  variables  for  independent  variables. 
The  independent  variables  to  be  replaced  are  source,  tone, 
and  type  of  change.   The  subjects'  perceptions  of  source  and 
tone  were  taken  from  the  dependent  variable  which  asked  the 
subjects  to  assign  100  points  to  the  factors  that  influenced 
their  decisions.   The  subjects'  responses  for  strength  of 
source  were  substituted  for  the  independent  variable  source. 
However,  because  the  source  response  and  the  tone  response 
were  not  independent,  the  measure  of  tone  could  not  be  used 
without  removing  the  systematic  effect  of  source.   This 
problem  was  overcome  by  regressing  tone  on  source  and  using 
the  residuals  as  a  measure  of  tone.  The  model  used  was 
Tone  =  a  +  b  x  Source  +  e.  The  residual  term,  £,  was  used 
as  a  measure  of  tone. 
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The  last  independent  variable   to   be   replaced  by   the 
subjects'   perceptions   was   type    of    change.      The   subjects' 
perceptions  were  measured  by  directly  asking  them   to 
classify  each   of   the   scenarios  they  worked.      These 
responses  were   used  in  the   perception  model   in  place   of   the 
type   of   change.      This  procedure  provides  a  built-in  measure 
of   the   subjects'    involvement  in  and  understanding   of    their 
tasks   by   comparing  subjects'   classifications  of   each 
scenario  with   the   dependent  variable    "difference."     A 
positive  value    for    "difference"   is  expected  to  result  from 
types  of   change  one  and  four.      On  the   other  hand,    a   type-2 
(type-3)    change    should   result   in  a    zero    (negative)    value   for 
"difference."     This  was  used  as  one   test   of   the   third 
hypothesis.      The   substitution  of    subjects'    perceptions   for 
intended  manipulations  results  in  a  revised  model,    which  is 
illustrated    in   Figure  3-4. 
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Figure  3-4.     Decision   Model   of   Perceived  Factors   Influencing 
Internal  Auditors'   Responses  to  External   Criticism   of    the 
System   of   Internal  Controls 


Subjects 
The  final  field  experiment  work  was  completed  using 
internal   auditors1   and  controllers  from   a  variety  of   sources 
in  two  types   of    settings.      In   the  first   setting   the 
experiment  was  administered  at  a  monthly  meeting  of  the 
Orlando,    Florida,    NAA  chapter.      Chapter    officers   asked 
members  to  participate  in  the  experiment.      However,    the 
conditions  under  which  the  experiment  was  administered  were 


^A  variety  of  subjects  was  used  in  both  the  pilot  and 
field  testing  phases  of   the  experiment.      Subjects   used   in 
early  pilot  tests  were  University   of   Florida  undergraduate 
auditing   and  accounting   Ph.D.    students.      The   pilot   was 
extended  to  the  field  by  using  a  small  sample  of  internal 
auditors  who  worked  for  an  independent   software   production 
firm   and  a   controller.      The   results  led  to  several    revisions 
of   the  experimental   instrument. 
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not  conducive  to  promoting  subjects'  concentration. 
Fourteen  responses  were  completed  at  the  meeting  and  another 
five  were  returned  by  mail.   The  experimenter  felt  that  this 
approach  to  gathering  data  was  unsuitable.   Therefore,  the 
rest  of  the  data  was  gathered  using  a  different  approach. 
Having  obtained  no  statistically  significant  difference  in 
responses  for  this  first  group  of  subjects  and  other 
subjects,  all  were  treated  as  a  single  group  (Statistical 
tests  are  presented  in  Chapter  V). 

The  second  approach  involved  contacting  individual 
presidents  of  NAA  chapters,  asking  them  to  assist  in 
distributing  experimental  packages  to  qualified  subjects  at 
their  monthly  meetings.   The  subjects  were  provided  with  an 
experimental  instrument  in  a  self-addressed  stamped 
envelope.   Each  envelope  had  an  index  card  attached  to  the 
outside,  reminding  readers  that  respondents  should  be  either 
internal  auditors  or  controllers.  No  provision  was  made  to 
detect  which  responses  came  from  which  chapter,  so  only  an 
overall  response  rate  can  be  computed.   In  addition  to  NAA 
chapters,  a  few  qualified  individuals  participated  along 
with  an  IIA  chapter  and  an  EDP  Auditors  Association  chapter. 
Table  3-5  provides  details  of  the  response  rate.  Of  the 
126  responses  received  before  an  arbitrary  cut-off  date,  one 
was  deemed  useless  due  to  its  incomplete  nature.   Some  of 
the  other  125  responses  were  only  partially  completed.   If  a 
subject  failed  to  complete  the  "other"  questions,  his 
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responses  were   used  nevertheless.     However,    if  a   subject 
failed  to  complete  a  dependent-variable  answer,    that 
particular   scenario  was  not   used.     There  were  5   instances   of 
partial    responses   to   dependent-variable  questions. 
Therefore,    there  were   495   completed  scenarios    (125   subjects 
x   4   scenarios  per   subject   =  500,   less  5    incomplete 
scenarios) . 
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Table  3-5.   Subject  Pool  and  Response  Rate 


Organization    City 


NAA 

Publix 

NAA 

NAA 

NAA 

EDP  Auditors 

and 
IIA 

PI.  State 
University 

NAA 

Eckerd  Corp. 

NAA 


Orlando,  PI. 
Lakeland,  PI. 
Houston,  Tx. 
Atlanta,  Ga. 
Wilmington,  De. 


Number  of 
Instruments  Accepted 

19   (only  non-mail  group) 

6 

50 
50 
100 


Jacksonville,    PI, 

Tallahassee,    Fl 
Miami,    Fl. 
Clearwater,    Fl. 
Baton  Rouge,   La. 


Total   instruments   distributed 

less  Orlando-NAA 

Total   instruments   distributed 
by  mail 

Total   number   of   responses 

less  Orlando-NAA 

Total  mail   responses 

Response  Rate    (107/355)    30% 


80 

6 
20 

8 
35 


374 
19 

355 

126 

19 

107 


The  method  used  to  select   subjects  was  not  random,    and 
the   selection   biases   are   unknown.     Selection   biases  may   be 
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attributable  to  differences  among  all  internal  auditors  and 
those  who  are  members  of  the  pool  of  possible  subjects  that 
were  selected.   There  may  be  differences  among  organizations 
which  agreed  to  participate  and  organizations  which  did  not 
participate.  Within  a  participating  group  there  could  be 
differences  between  those  who  were  qualified  to  participate 
and  those  who  chose  to  participate.  Even  though  a  similar 
appeal  was  made  to  the  leadership  of  each  participating 
organization,  there  may  have  been  differences  in  the 
leaderships1  approaches  to  subjects  themselves.   it  is 
impossible  to  test  for  most  of  these  differences.  However, 
it  is  hoped  that  geographic  diversification  and  the 
reasonably  large  sample  size  will  mitigate  any  effects  of 
self-selection  biases. 

Chapter  Summary 
A  description  of  the  experimental  instrument  and  the 
dependent  and  independent  variables  was  detailed.  This 
chapter  also  developed  a  simple  description  of  corporate 
behavior  within  a  very  limited  scope.  The  dependent  and 
independent  variables  were  related  to  the  description,  and 
the  groundwork  was  laid  for  a  statistical  analysis,  to  be 
presented  in  the  next  chapter.   The  research  design  to  be 
used  in  the  experiment  was  presented  along  with  a 
description  of  the  subjects  and  the  pretesting  of  the 
experimental  instrument.   Finally,  three  hypotheses,  which 
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are  repeated  below,   were  included  in  the  discussion.     The 
results  of    the  hypotheses   are  presented  in  Chapter  V. 


Hj :      The  more  ambiguous  the  decision,    the   greater   the 

subject's   reliance   on  the   source   and   tone   of   the  message. 

H2:      There  is  no  difference  between  the  amount   of   reliance 

subjects   place    on  the   source    (either   external   auditors  or 
systems  analysts)    of    the    criticism. 

H3:     The  change  in  the  internal  control  ratings  will  be  a 

function  of   the   subject's   classification   of    the    type    of 
change,    as   is   specified  in  Table  3-4. 


CHAPTER  IV 
CAUSAL  MODELS  AND  PATH  ANALYSIS 


Since  several  variables  are  measured  in  this  study  and 
several  relationships  are  simultaneously  hypothesized,  it  is 
necessary  to  examine  the  nature  of  causality  in  the  proposed 
model  of  behavior  in  order  to  strengthen  the  inferences  that 
may  be  drawn  from  the  results  of  the  experiment.   The 
analysis  of  causality  also  prompts  the  appropriate  statistical 
procedures  that  are  necessary  for  testing  (path  analysis, 

etc.)  . 

Correlation  among  variables  may  be   the  result  of   cause 
and  effect.      In   general,    it  is  agreed   that,    in   order   to 
show   causal   relationship,    three  conditions  must  be 
satisfied:    (1)    the  variables  must   be   correlated;    (2)    the 
cause  must   precede   the  effect   in  time;    and    (3)    alternative 
hypotheses  must  be  eliminated    [Abdel-khalik  and  Ajinkya,   1979, 
p.  26   and  Asher,  1976,  p.  11].     Therefore,  to  show  that  the 
model   proposed  in  this   study   is   a  valid  contender   against 
other  models,    the  sequence   in  which  the  variables  occur  and 
alternative  hypotheses  must    be    considered. 
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For  discussion  purposes,  the  proposed  model  (Figure  3- 
5)  can  be  reduced  to  four  variables  by  combining  source  and 
tone  (because  these  two  variables  are  neither  considered  to 
be  independent,  nor  are  they  measured  independently).  For 
convenience,  the  four  variables  are  abbreviated  as  shown  in 
Table  4-1. 

Table  4-1.  Abbreviated  Form  of  Variable  Names 

Long  Form  Abbreviated  Form 

Measured  Importance  of 
Source 

and  _  st 

Measured  Importance  of 
Tone  (Residuals) 

Classification  of  c 

Type  of  Change 

Importance  of  i 

Internal  Control  Procedure 

Decision  d 

It  is  convenient  to  represent  causal  relationships 
using  an  arrow  diagram,  as  used  in  Asher  [1976,  p.13],  who 
defines  three  types  of  variables:  exogenous,  endogenous,  and 
residual.   In  the  current  model,  c.  and  s_t  are  exogenous 
variables  (see  Figure  4-1).   Endogenous  variables  are 
affected  by  other  variables;  in  the  model,  i 
and  d.  are  endogenous  variables.   Residuals  are  those 
factors,  not  actually  measured,  that  impinge  upon  the 
endogenous  variables. 
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As  a  result  of  combining  source  and  tone  into  the 
single  variable  it,  the  model  may  now  be  presented  as  a 
four-variable   causal   model.     The  abbreviated  model   is 
presented  in  Figure   4-1   with   the  four  variables  arranged  in 
a    causal   network. 


st 


->  d   <- 


i    <- 


Structural   Equations 
i   =   picc  +   piuRu 

d  "   Pd  stst   +   Pdcc   +   Pdi1   +   PdvKv 
Figure   4-1.      Four-Variable   Causal   Model 


Spurious   effects  can  be   illustrated  using  three  of   the 
variables  in  the  model   adopted   in   this   study:   £,   ±,    and   d.. 
In  the  model  c.  affects  d.  in  two  ways.     There  is  a  direct 
effect  by^ondand  perhaps  an  intermediate  effect  through 
i.      This   relationship   is  modeled   in  Figure  4-2. 
c 


d   <- 


Figure  4-2.   Model  of  the  Relationship  Between  Change, 
Importance,  and  Decision 


The  role  of  the  middle  variable,  i.,  in  the  model  can 

never  be  known  with  certainty  as  a  result  of  statistical 

tests.   As  Simon  pointed  out: 

We  begin  with  a  set  of  observations  of  a  pair  of 
variables,  x  and  y.  We  compute  the  coefficient  of 
correlation,  rx„,  between  the  variables,  and 
whenever  this  coefficient  is  significantly 
different  from  zero  we  wish  to  know  what  can  be 
concluded  from  the  causal  relation  between  the  two 
variables.   If  we  are  suspicious  that  the  observed 
correlation  may  be  derived  from  'spurious'  causes, 
we  introduce  a  third  variable,  z,  that,  we 
conjecture,  may  account  for  this  observed 
correlation.  We  next  compute  the  partial 
correlation,  rx„  z,  between  x  and  y  with  z  'held 
constant,'  and  compare  this  with  the  zero  order 
correlation,  rxy.   If  rxy  _  is  close  to  zero, 
while  r„v  is  not,  we  conclude  that  either:  (a)  z 
is  an  intervening  variable;  or  (b)  the  correlation 
between  x  and  y  results  from  the  joint  cause  of  z 
on  both  those  variables,  and  hence  the  correlation 
is  spurious.   [1954,  p.  468] 

In  other  words,  if  the  variable  i  is  added  to  a  model 

to  explain  the  covariation  between  £  and  d.,  one  cannot  use 

statistical  methods  to  distinguish  between  c  — >  i  — >  d  and 

c  < —  i  — >  d.   However,  the  knowledge  of  the  sequence  of 

the  events  and  common  logic  should  indicate  that  the 

perceived  importance  of  an  internal  control  procedure  did  not 

cause  an  external  auditor  to  propose  a  particular  type  of 

change  (especially  deletion  of  a  complement  or  addition  of  a 

substitute).   Therefore,  it  can  be  safely  concluded  that  £ 

affects  d  indirectly  through  i,  c  — >  i  — >  d, 

provided  that  rcdi  =  0. 
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Blalock  applied  Simon's  work  to  all   possible  four- 
variable  models    [1962].      For   each   of   the  non-trivial    four- 
variable  models,    Blalock   offered  a   test   of   fit.      Basically 
the  test   indicates  which   specific  correlations  among  the 
four  variables   needs  to   be  zero  in  order   not  to   be  able  to 
reject  a   particular  model   as  appropriate.      He  did  not 
provide  a   test   of  which  model    fit    "best."     However, 
Blalock's  procedure,    which   allows  us   to  reject  a  model, 
provided  considerable   insight  into  the  modeling   process. 
Figure  4-1  is  similar  to  Blalock's  model  Al  which  is 
reproduced   below   in   Figure   4-3. 


Xi 


x„  < 


>4     V A3 

Figure   4-3.      Blalock's  Model   Al 


It   is  convenient   to   show   that  Blalock's  model   Al   and 
the  model  proposed   in   this   study  are  analytically   identical 
so   that   Blalock's  analysis   can   be   adapted  to   the   study's 
model.     Blalock   restricted  his  models  to   the   simplest   case, 
recursive  models.      To  be   recursive,    the  first  variable  in 
the   chain,    X^,    depends  only  on  variables  outside   the  model. 
Variable   X2,    the  second  variable,    can  depend  only  on  Xj. 
This   causal    dependence   is  written:      X-^   — >     X2.      In  an 
analogous   fashion,    X3  can  depend  only  on  Xj,    or   X2,    and  X* 
depends  on   some   combination   of   Xj,    X2,    and  X3. 
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Of   course,   how  Xlr   X2,    and  X3   relate  to  X4   is    unknown; 
but   if   the  variables  are  modeled  in  a   particular   fashion, 
that  model   can  be  eliminated  because  each  model   predicts 
certain  vanishing   correlations.      Therefore,    Blalock's 
technique  provided  a   practical   method  to   support  a 
hypothesis  indirectly  by  specifying  which  other  hypotheses 
could   be   rejected.      The  method  does  not  insure   the   rejection 
of   all    incorrectly  specified  hypotheses.      If   the  absence   of 
a  link   is  hypothesized,    a  false  hypothesis   can  be  rejected 
based  on  the  presence   of   a  non-vanishing  correlation.      To 
apply  Blalock's   technique,    the  model's  variables  must   be 
recursive  (the  model  must  proceed  in  time,  and  it  can  have 
no   feedback    loops). 

To  affect   causality,    the  experiment  was  conducted  such 
that  the  subjects  were  exposed  to  the   independent  variables 
corresponding  to   change    (c_)    and  source-tone    (s_fc)    before   they 
were  asked  to  respond  to  the  questions  that  were  used  as  the 
variables  i  and  d.     Also,    the  i  question  always  preceded  the 
jj  question.     Therefore,    the   timing  of   the  variables,    with 
the  exception  of   the  first  two,   followed  the   sequence:  Xj^   s 
c,  X2  E  st,  X3  ■  i,  and  X4  ■  d.      It  will  be  shown  that  the 
ambiguity  of   precedence   between  s.  and  £fc  is  unimportant. 
However,    cognitive  dissonance   theory  might  suggest  that 
after   the  decison,    earlier   perceptions  could  be  altered, 
forming  a  feedback  loop.     On  the   other  hand,    subjects  were 
asked  the  questions   in  a   particular   order.      If   feedback 
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occurred,  it  would  occur  in  another  scenario.   Therefore, 
the  absence  of  a  feedback  loop  will  be  assumed.   It  can 
easily  be  shown  in  what  follows  that  the  time  ordering 
between  £  and  s_t  is  unimportant  to  the  model. 

Notice  that  in  Figure  4-3,  Xx  and  X2  have  no  connecting 
arrow.  Other  than  the  arrow  between  X1   and  X4,  Figure  4-3 
is  symmetrical.  If  we  reverse  the  order  of  £  and  ££  so  that 
£i  corresponds  to  Xx  ,  then  the  model  would  be  unchanged  as 
long  as  the  original  X2  was  still  linked  to  X4. 

Blalock  specified  that  the  model  can  be  rejected  if  r12 
H  0  (link  between  X2  and  X2)  or  if  r23  H  0  (link  between  X2 
and  X3).   These  relationships  are  stated  as  null  hypothesis 
4. 

H4!   r12  =  "   and   r23  "  "• 

Path  estimates  in  a  recursive  model  are  found  using 
regression.   "To  obtain  estimates  of  the  main  path 
coefficients,  one  simply  regresses  each  endogenous  variable 
on  those  variables  that  directly  impinge  upon  it"  (Asher, 
1976,  p.  29].   Residual  paths  are  also  easily  found  from  a 
regression.   "Since  standardized  variables  have  a  variance 
of  one,  the  general  expression  1-R2  is  simply  the  proportion 
of  unexplained  variance.   Therefore,  the  residual  path 
coefficient  is  simply  the  square  root  of  the  unexplained 
variation  in  the  dependent  variable  in  question"  [Asher, 
1976,  p.  31]. 
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A  series  of  assumptions  are  necessary  in  order  to 
perform  path  analysis.   These  are  based  on  the  regression 
analysis  assumptions.  The  regression  assumptions  about  the 
error  term  are 

(1)  its  mean  is  zero; 

(2)  it  has  a  constant  variance  for  different 
values  of  X^  (homoscedasticity)  ; 

(3)  pairs  of  error  termB  are  uncorrelated; 
and 

(4)  the  independent  variables  and  error 
terms  in  the  same  equation  are 
uncorrelated.  [Asher,  1976,  p.  25] 

For  regression,  it  is  also  necessary  to  assume  a 
normally  distributed  error  term  with  the  models  being 
linear  in  the  b^    's  [Asher,  1976,  p.  25]. 

In  addition  to  the  regression  assumptions,  Blalock's 
technique  requires  that  the  model  be  recursive,  and  the 
independent  variables  are  assumed  to  be  measured  without 
error  [Asher,  1976,  p.  27].   The  last  assumption  might  give 
concern  if  the  path  analysis  were  used  to  examine  non- 
experimental  data.  However,  in  this  experiment,  the 
independent  variables  were  controlled. 

In  this  study,  estimation  of  the  following  paths  is  of 
interest  (refer  to  Figure  4-1):  (1)  pd  st(2)  pic;  (3)  pdc; 
(4)  pdi;  (5)  PiRu;  (6)  PdRv;  and  (7)  pc  8t.   The  method  of 
estimation  and  regression  formulas  used  to  find  these  p^j  's 
is  given  in  Table  4-2. 
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Table   4-2.      Formulas  Used  to   Generate   Path   Coefficients  Used 
in  the  Model 


1 
d 
i 
d 
d 
i 


J 

st 

c 

c 

i 


st 


Regression  Model 


Model  1 
Model  2 
Model  1 
Model  1 
(1-R2)-5 


(1-R2)-5 


where  R     comes  from   the   regression 
using  Ru 

o 
where   R     comes  from   the   regression 
using  R^ 


c  st 


Regression  Models 

Model  1:   d  =  pd  st  st  +  pdc  c  +  pdi  i  +  pdRv  P^ 

Model  2:   i  =  pic  c  +  piRu  Ru 

The  decomposition  of  correlation  between  two  variables 
depends  on  the  technique  used  to  estimate  the  path 
coefficients,  pAj  's.   The  pAj  's  may  be  estimated  by:  (1) 
solving  simultaneous  equations  (see  Simon),  (2)  multiplying 
by  structural  variables  and  then  solving  (see  Blalock),  or 
(3)  by  using  regression  coefficients.   In  any  event  it  is 
mathematically  convenient  to  standardize  the  data  before 
computing  the  p^j  's.   If  regression  coefficients  are  used 
to  estimate  the  p^j  's,  the  regression  coefficients 
themselves  may  be  standardized.   In  this  study,  standardized 
data  was  used  in  Ordinary  Least  Squares  Regression  to 
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estimate   the   pA^  's.      The    correlation   coefficients  and 
partial   correlation   coefficients  used  to  estimate   the  p.^   's 
were   not    standardized. 

"If    the  model   were   specified  correctly",    (see 
hypothesis   4)    "then    (except  for  measurement  and  sampling 
errors)   the  empirical   correlation  between  any  two  variables 
should  be  numerically  equal  to  the  sum   of   the   simple  and 
compound  paths  linking  the  two  variables"    [Asher,    1976,    p. 
3  4],     A  compound  path  is  equal   to  the  product   of   the   simple 
paths  comprising  it.      Therefore,    to  decompose   the 
correlations  in  a  model,   it  is  necessary  to  identify  each 
path  between  variables  according  to  the  following  rules: 

(a)  no  path  may  pass  through   the   same  variable 
more   than  once; 

(b)  no  path  may  go  backward  on  an  arrow  after  the 
path  has  gone  forward  on  a   different  arrow; 

(c)  no  path  may  pass  through  a  double-headed 
curved  arrow  more   than  once  in  a   single  path. 
[Asher,  1976,  p.  33] 

Once   the   paths  have  been  identified,    the  correlations 

can   be   decomposed  into  three   categories:     (1)    direct   effects, 

(2)    indirect   effects,    (3)    and  non-causal    effects.      The 

direct  effects  are  the  direct  paths   between  the   two 

variables.      The   indirect  effects  are  the  compound  paths 

which  are  followed  without  going  through  a   double-headed 

curved  arrow   or   going  backward  on  an  arrow.      All  paths  other 

than   direct   or  indirect  are   non-causal.      The   correlations 

and  their  connecting  paths  used  in  the  four-variable  model 

are   given   in  Table   4-3. 
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Table   4-3.      Correlation  Pairs  and  Connecting  Paths  for    the 
Four-Variable  Model 


Variables 
First  Secc 

>pd 

Causal 
Direct 

Pa 

ths 
Indirect 

Non-Causal  Paths 

c 

St 

rc  st 

none 

none 

c 

i 

Pci 

none 

none 

6 

c 

Pdc 

Pic  Pdc 

Pc  st  Pd  st 

d 

st 

Pd  st 

none 

Pc  st  Pdc 

+Pc  st  Pic  Pdi 

d 

i 

Pdi 

none 

Pic  Pdc 
+Pic  Pc  st  Pd  st 

i 

st 

none 

none 

Pic  Pc  st 

The  model   proposed   in  this   study   is  a  five-variable 
model   rather   than  the   simplified  four-variable  model   used  to 
illustrate   causal    analysis.      Blalock's   four-variable  model 
is  an  extension   of    Simon's   and   others'    three-variable 
models.      The  ability  to  generalize  the  principles  of   earlier 
work  to  an  n-variable  model    is   specified   in  Simon    [1971,   p. 
5].      The   study's   five-variable  model    is  derived  by 
separating   the  variables  ££  into   two  variables,   £  and  i. 
The  five-variable  model    is  presented  in  Figure   4-4. 
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i  <- 


Structural  Equations 

i  =  Picc  ♦  PiuRu 

<*  ■  Pdss  +  Pdtfc  +  Pdcc  +  Pdi1   +  Pdv*v 

Figure   4-4.      Five-Variable   Model 

Hypothesis  4   should  now   be   restated  to  fit  the  five- 
variable  model.      A  five-variable  model   could  have  as  many  as 
<2>    =  10   links.      However,    only  eight  links  are  included  in 
the  model.      The   two  missing   links   are    (1)    pt^   and    (2)    psi. 
In  addition,    the  double-headed  curved  arrows  indicate   that 
the   three  links  among   the   independent  variables,    pst,    psc, 
and  Pj-c'    are   t0  De   considered  exogenous   to  the  model. 
Therefore,    the  Blalock  technique  would  indicate   two 
vanishing  correlations  associated  with  paths  pt^   and  psi. 
In  other  words,    rg^  tc  and  rt^_sc   should   be  approximately 
zero.      The   two  uninvolved  independent  variables  are   "held 
constant"  to  prevent  a  spurious   correlation  that  might  occur 
if   rst,   rsc,  or  rtc  ^  0.     Therefore,   it  would  not  be 
desirable   to   reject   hypothesis   4. 
Hz:      rn    ,,„  =  0   and  rc 


• ti.sc 


si.  tc 
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The  computation  techniques  for   the   paths   based  on  the 
five-variable  model   are  presented  in  Table  4-4.     Also,    the 
decomposition  of   the    f5,)    =  10  correlation   combinations  is 
given   in  Table   4-5.      The   techniques  described  in  this 
chapter  together  with  the  formulas   given  in  Tables   4-4  and 
4-5  represent  the  method  used  for  the  analysis  of  data  in 
Chapter  V. 

Table  4-4.      Formulas  Used  to   Generate   Path  Coefficients  in 
the  Five-Variable  Model 

1  j  Regression  Model 

d  s  Model  1 

d  t  Model  1 

d  c  Model  1 

d  i  Model  1 

i  c  Model  2 

s  t  rst 

t       c  rtc 

8   c  rsc 

i   Ru        *1-R  >    where  R2  comes  from  the  regression 

ing  Ru 

I  R2  Ct 
using  Ry 


(1-R  )':'      where  Rz  comes  from  the  regression 


Regression  Models 

Model  1:   d  =  pds  s  +  pdt  t  +  pdc  c  +  pdi  i  +  pdRv  Rv 

Model  2:   < 
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Table  4-5.   Correlation  Pairs  and  Connecting  Paths  for  the 
Five-Variable  Model 


Non-Causal  £a_tll£ 

Pdt  Pst  +  Pdc  Pes 
+  Pdi  Pic  Pes 
Pds  Pst  +  Pdc  Pet 
+  Pdi  Pic  Pet 
Pdt  Pet  +  Pds  Pes 
Pdc  Pic  +  Pdt  Pet  Pic 
+  Pds  Pes  Pic 
none 

Pic  Pet 
Pic  Pes 
rct 
rcs 
rst 


Vari 
1 

.able 
j 

Causal  Paths 
Direct    Indirect 

d 

s 

Pds 

none 

d 

t 

Pdt 

none 

d 

c 

Pdc 

Pic  Pdi 

d 

i 

Pdi 

none 
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Pic 

none 

i 

t 

none 

none 

i 

E 

none 

none 

c 

t 

none 

none 

c 

S 

none 

none 

s 

t 

none 

none 

CHAPTER  V 
ANALYSIS  AND  RESULTS 


In  Chapters  III  and  IV,  four  hypotheses  were  developed 
and  the  path  analysis  model  was  discussed.   In  this  chapter, 
the  path  analysis  is  performed  and  the  hypotheses  are 
tested.   Some  background  tests  are  done  first. 

The  background  work  is  organized  in  three  sections:  (1) 
disposition  of  missclassif ied  responses,  (2)  intended  vs 
perceived  classification,  and  (3)  subject  reliability.   The 
first  section,  disposition  of  misclassif ied  responses,  is 
devoted  to  determining  whether  or  not  to  include  in  the 
analysis  data  from  scenarios  that  were  missclassif ied  by 
subjects.   In  the  second  section,  the  effect  of  classifying 
the  data  as  perceived  rather  than  as  intended  is  analyzed. 
"Intended"  refers  to  the  author's  intended  manipulation  of 
the  independent  variables.   "Perceived*  refers  to  the 
subjects'  perceptions  of  what  the  values  of  the  independent 
variables  were.  The  third  section  examines  subject 
reliability  by  specifically  including  in  the  analysis  the 
responses  of  subjects  who  missclassif ied  most  of  their 
responses. 
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In  the  remainder  of   the   chapter   each   of   the  following 
hypotheses  is  addressed. 


Hj^:  The  more  ambiguous  the  decision,  the  greater  the 
subject's  reliance  on  the  source  and  tone  of  the 
message. 

H2:     There  will   be  no  difference  between  the  amount  of 
reliance   the  subjects   place  on   the    source    (either 
external   auditors  or   systems  analysts)   of   the 
criticism. 

H3:      The  change  in  the  internal  control  ratings  will  be  a 

function  of   the   subject's   classification   of    the   type    of 
change,    as   is   specified  in  Table  3-4. 

H4:      The   path  analysis  model  will   fit,    i.e., 
rti.sc  =  0   and  rsi.tc  "   "■ 

For   convenience   the  variables  may  be   referred  to  in  an 
abbreviated  form.      The  variables  and  their  abbreviations  are 
given   in  Table   5-1. 
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Table  5-1.  Abbreviations  for  Variables 
Abbreviation  Variable 

s        Source 

t        Tone 

c  Type   of   Change 

i  Importance   of   Procedure  Being  Changed 

d  Subject's  Decision-  Recommendation  to  Audit 

Committee 

diff.  Difference-   Subject's    Final    Evaluation  of 

Scenario's   Internal    Control    Minus   Initial 
Evaluation 


Type  si  Control 

T        Transaction  Origination 

E        Transaction  Entry 

P        EDP  Processing 
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Disposition  of  Missclassif ied  Responses 
Whenever  a  subject  answered  question  four  (classify  the 
type  of  change  being  recommended)  differently  from  the 
expected  response,  his  response  was  labeled  missclassif  ied. 
Table  5-2  provides  a  breakdown  of  the  percentage  of 
responses  which  were  missclassif  ied  by  type  of  change  and 
type  of  EDP-control  task.   There  were  four  types  of  changes 
(add  a  complement,  delete  a  complement,  delete  a  substitute, 
and  replace  a  substitute  with  a  complement)  and  three  types 
of  EDP-controls  (transaction  origination,  transaction  entry, 
and  EDP  processing). 


Table  5-2.  Table  of  Missclassif ied  Responses  as  a  Percentage 
of  All  Responses 

Type  of  Change 

T  C  II       12       |3       14       iTotal 

y  o  + + + + + 

p  n  E        I    10%  I    26%  I    35%  I    47%  I  30% 

e  t  + + + + + 

r    P        |    18%  I    77%  I    79%  I    51%  I  56% 

o   o    + + + + + 

f   1    T        I    13%  I    20%  I    50%  I    55%  I  35% 

+ + + + + 

Total  14%  41%  54%  51%    I    40% 


In  Table  5-2,   cells  P2  and  P3   represent   the  worst 
missclassif ications   by  subjects.      Therefore,    those   two   cells 
are   selected  for   further   examination.      In  cell   P2,    the 
correct  answer  would  have   been   "C",    delete  a   complement. 
(Refer   to  Table  3-4   for   a   complete   list   of   expectations  by 
type   of   change.)      In  Table  5-3,    the   P2   responses   are    sorted 
by   answers   to  question  four. 
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Table   5-3.      Distribution   of   Subjects'    Classification   of 
Type-P2   Scenarios 


Perceived  Type  of  Change 

|A       |B       |C*       ID,  E,  &  Gl   Total 
+ + + + + 

Frequency  |  8    I  18    I  10    |  7      |  43 

Percent    I      18.60    I       41.86    I      23.26    I      16.29      I    100.00 
_ + + + + + 

indicates   correct  response 


Most    of    the   incorrect    responses   were   "B"  or    "A." 
A  response   of   "B"  indicated  that   the   subject   thought   the 
change   was  an  addition  of   a   substitute,    while  response   "A" 
indicated  that  the   subject  perceived  an  addition  of  a 
complement.      In   other    words,    60.46%    (18.60%    +   41.86%) 
of   the  subjects  missclassif ied   this   change  as  an  addition 
rather   than  a   deletion  of  a  complement.      Examination  of  the 
scenario  in  question    (see  Appendix   B)    shows   that   the 
recommended  change   involves  adding  to  the  duties  of   the  tape 
librarian.      The  additional   duties  are  in  violation  of    the 
separation  of   duties   concept.      Therefore,    the  correct  answer 
to  question  four    should   be   "C",    deletion   of   a   complement. 
Subjects  who  analyzed  this  scenario  as  an  addition  of  a 
control  were  most  likely  confused  between  the   classification 
of   adding  duties  and  adding  a   control.      Perhaps   the   42%    who 
answered   "add  an   undesirable   control"   thought   of    the   added 
duties  as   "adding  a    control"  but   correctly  analyzed  that 
the   change  would  have  an   ill    effect. 
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In  Table   5-4,    the  P3   responses  are   sorted  by  answers  to 
question  four. 

Table   5-4.      Distribution  of    Subjects'    Classification  of 
Type-P3   Scenarios 

|A,    B,    &  FIC                 ID*               IE                 I      Total 
+ + + + + 

Frequency  I  8      1  17    I  8    1  6    1  39 

Percent    I      20.51      I       43.59    I       20.51    I      15.38    I    100.00 

+ + + + + 

indicates  correct  response 


Examination  of  scenario  P3  (see  Appendix  B)  reveals 
that  the  intended  change  was  from  maintaining  six  months  of 
backup  tapes  to  maintaining  three  days  of  backup  tapes  for 
the  master  and  transaction  files.   The  grandfather,  father, 
and  son  (three  days  of  tapes)  are  considered  adequate  in  the 
literature  to  reconstruct  the  current  balance  and  the 
history  of  the  account,  if  you  assume  that  the  account 
contains  a  history  of  past  transactions.   Therefore,  the 
expected  answer  was  "D",  delete  a  substitute.   The  43.59% 
who  responded  "C",  delete  a  complement,  may  have  considered 
the  additional  backup  tapes  necessary,  especially  if  they 
thought  that  the  master  file  contained  only  the  current 
balance.   In  that  event,  the  old  transaction  tapes  would  be 
necessary  to  reconstruct  the  account  histories. 
Dnf ortunately,  the  detailed  nature  of  the  master  file  was 
not  included  in  this  scenario.   Furthermore,  if  the  subject 
understood  the  change  as  recommending  the  trading-in  of  the 
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six-month  policy  in  favor   of   the   three-day  policy,    he  may 
have   responded  to  question  four   with   an   "E",    replace   a 
substitute  with  a   substitute.      15.38%   of    the   subjects 
responded  "E." 

From   the  analysis  of   some  of   the  missclassif ied 
responses,    it   can  be   seen,    after-the-fact,    that  subjects 
might  have  had   "legitimate"  reasons  for  missclassifying 
scenarios.     This  raises  a  question  of  whether   the   remaining 
analysis   should  be   performed  on  data   classified  by  intended 
manipulations  or  on   data   classified  according  to  the 
subjects'   perceptions. 

Intended  vs  Perceived  Classification 
The  results  were  analyzed  to   determine   if   the  author's 
intended  manipulations  of   the  variable,    type   of   change,   were 
correctly  perceived   by   the   subjects.      This  analysis  was 
accomplished  in  two  ways. 

First,    the   subjects'    classification  of   the  proposed 
change    (question  four),   was   compared  with   the  intended 
manipulation.      For   example,    the  expected  response   to  a   type- 
1   change,    add  a   complement,    was   "A"    (see   table  3-4).      Table 
5-2  shows  that  40%   of   all   scenarios  were  missclassif  ied. 

Second,    the   subjects'   responses  were   compared  to 
responses  that  would  be  expected   if   they  had  correctly 
perceived  the  intended  manipulation.      For   example,    the 
expected  value   of    the  variable   "difference"  for   a   type-2 
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change,    delete  a  complement,    was  a   decrease  or  negative 
value    (see   Table   3-1).      The  responses  for   each   category  were 
classified  and  compared  to  the  expectations   shown  in  Tables 
3-3   and  3-4.      The   results,    displayed   in   Figures  5-1   and  5-2 
and  Table  5-5,    show   that  the   perceived  classification 
results  are  more  consistent  with  the  expectations  than  are 
the  results   based  on   intended  manipulations. 
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Expectations  for  Average   of  Variable    "Difference" 

Intended  Perceived 

Label  Lshsl  Expectation 

Type-1  A  Positive 

Type-2  C  Negative 

Type-3  D  zero 

Type-4  F  Positive 


Figure  5-1.      Plots  of    the   Average   of  Variable   "Difference* 
a   Function  of   Intended  and  Perceived  Changes 
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Expectations  for  Average  of  Variable  "Decision": 

Intended  Perceived 

Lab£l  Lshsl  Expectation 

Type-1  A  Positive 

Type-2  C  Negative 

Type-3  d  Positive 

Type-4  F  Positive 


Figure   5-2.      Plots  of    the  Average   of   the  Variable   "Decision" 
as  a   Function  of   Intended  and  Perceived  Changes 
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Table  5-5.      Comparison  of   the   Intended  and  Perceived 
Results 

Average   by  Type   of   Change   for  Variable   "Difference" 


Perceived 

Classification 

3.0 

-2.9 

-0.2 

1.2 

Intended 

Classification 

3.2 

-1.9 

-1.3 

0.3 

Expectation 

Positive 

Negative 

Zero 

Positive 

Test 

p  >  I** 

P   <   I 

P=0 

l\B 

P   >  I 

Result 

I    >  P 

p   <  I 

P=0 

i\e  t 

p   >  ** 

z-score 

.721 

3.54 

I:    6 
P:    1 

.267 
.232 

3.748 

Average   by  Type   of   Change  for  Variable    "Decision" 
12  2  1 


Perceived 
Classification 
Intended 
Classification 

Expectation 
Test 
Result 
z-score 


2.5 
2.4 


-2.2 
-1.5 


2.2 

0.0 


2.7 
1.3 


Positive  Negative  Positive  Positive 

P>I  P<I  P>I  P>I 

P>I  P<I*  p>1*  p>1* 

.471  2.905  6.937  5.614 


Notes 

J  =  Intended 


Perceived 


denotes  significance  at  alpha  ■  0.05 
denotes  case  not  in  the  expected  direction 

z-scores  were  computed  using  the  formula  for  large 
sample  tests  of  difference  in  means. 

*1  "*2 


[(s2/ni)  +  (s|/n2)  ]"5 


Type-3.      Because   the   prediction   for    the   Type-3   "difference" 
was  that  both  the  intended  and   the   perceived  results  would 
equal   zero,    two  separate  tests  were  performed  to  see  if   they 
were  different  from  zero.     For   a   two-tailed  test  with 
alpha  =   0.05,    z  1  1.96. 
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Examination  of   Figures  5-1   and   5-2  indicates   seven  out   of 
eight   cases    (Figure   5-1 -decision:    type-2,    type-3,    and  type-4; 
Figure   5-2-diff erence:    type-1,    type-2,    type-3,    and   type-4) 
in  which   the  perceived  classification  gave  more  positive 
(negative)    results  when   positive    (negative)    results   were 
expected.      Table  5-5  contains  the  result  of   statistical 
tests  for  the  differences  in  three  pairs  of  the  eight  means 
represented   in  Figures  5-1   and   5-2.      The  z-scores  are  for 
one-tailed  tests  of   differences   between   corresponding 
(perceived  and  intended)    means  for   each   type   of   change.      Two 
tests  for   the  variable   "difference"  type-3   change   were 
necessary  because   the  null   hypothesis  is  that  the   intended 
and  perceived  means  equal   zero.     To   show    that  perceived  data 
is  more  consistent  with  the  expectations,    the  z-scores 
should  be:    (1)    significant  for   all   the   differences   in   the 
means,    (2)    significant   for    the  variable   "difference"   type-3 
intended,    and    (3)   not   significant  for    the  variable 
"difference"   type-3   perceived    (should  not  be   different  from 
zero).      In  one   case    (type-1)    the  means  were   in  the   wrong 
direction,    but  the  difference  in  the  means  was  not 
significant.      Of   the   remaining  correct-direction   cases,    all 
but   one   were   statistically   significant    (see   Table  5-5). 
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The  above  results   indicate   that  experimental 
observations   classified  by  perceived  manipulations  are 
different  from  those   classified   by  intended 
manipulations.      Furthermore,    perceived-classif ication 
results  are  more   similar  to   the  expectations  expressed 
in  Chapter    III   than  are  intended-classification  results. 
Therefore,    the   rest   of   the  analysis  emphasizes   perceived- 
classif  ication    data. 


Subject  Reliability 
Some  of  the  subjects   did  not  interpret  the  scenarios  as 
intended.      Therefore,    there   is  a   question  of    reliability. 
The  first  approach   taken  to  verifying   the   subjects' 
reliability   was  to  classify   the   subjects'    responses  as 
"good"  or   "bad"  depending  on   the   way   they   classified   the 
scenarios.      A  subject's   responses  was   classified  as   "bad"   if 
75%  or  more  of  his  answers  to  question  four  (identify  the 
type   of   change)   disagreed  with   the  expected  answer    (intended 
type   of   change).      All   other   subjects  were   classified  as 
"good."     Once    identified,    separate   data    sets  were   designated 
"all-subjects",    "good-subjects",     "bad-subjects",    and    "only- 
good-responses."     The    "all-subject"   data    set   contained  all 
responses  no  matter  how   the  subject  was   classified.      The 
"good (bad) -subject"   data    set   contained  the   responses  of 
subjects    classified   as    "good"    ("bad").         The    "only-good- 
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responses"  data   set   contained  only  the   scenarios  in  which 
the  answer   to  question  four   agreed  with  the  intended  type  of 
change.      The  means  of   the  variables    "difference"  and 
"decision"  were  computed  for   each   intended  type   of   change 
within  each  data  set.      The  means  were   then   compared  across 
data   sets.      Comparisons  were  made   between  the  following  data 
sets:     (1)    "all-subjects"   vs    "only-good-responses",     (2)    "all- 
subjects"   vs    "bad-subjects",     and    (3)    "all-subjects"  vs 
"good-subjects."     These   same      comparisons  were   repeated   for 
perceived   classifications  of   type   of   change.      For   each 
comparison,   a   statistical   test  for   differences  in  a 
population  was  performed.     The   test   scores  are  presented  in 
Table    5-6. 


Table  5-6.      Scores  Resulting  From  Comparisons  Between 
Dependent  Variables   Classified   by  Type   of   Change    (Intended 
and  Perceived)   and  Sets  of   Missclassif ied  Data 

Type   of       All  vs  Only-Good         All  vs  Bad  All  vs  Good 

Change  Mff^.  Dec.  Jiifl^.  Dec.  Diff .      figCj. 

Intended 

type-1  0.41  0.11  0.51   4.11  0.21  1.35 

type-2  0.73  0.56  0.004  0.00.  2.06  2.37* 

type-3  1.07  1.06  2.97.  5.32.  0.00.  7.08* 

type-4  0.73  0.49  2.92  3.58  3.24  5.35 

Perceived 

type-1  0.21  0.12  2.47      2.19  0.93  0.99 

type-2  0.87  0.10  0.00      0.00  1.15  0.38 

type-3  0.26  0.31  1.08..1.13.4  0.88  0.68 

type-4  0.31  0.17  4.66      8.35  0.45  0.22 

71  df   71  df 

df        denotes   degrees  of   freedom  for   score  above 

denotes  significance  at  alpha  =  0.05,    z-test 
**  denotes   significance  at  alpha   =  0.05,    t-test 
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An  examination  of  Table  5-6  indicates  no  systematic  reason 
to  exclude  any  group  identified  from  further  computations.   When 
"all-subjects"  is  compared  with  "only-good-responses",  no  type  of 
change  is  different.   When  "bad"  subjects  are  eliminated  from  the 
total  population  the  result  is  "good-subjects."  The  perceived 
classifications  show  no  difference  between  the  groups  "all- 
subjects"  and  "good-subjects."  Furthermore,  when  comparing  the 
"all-subjects"  group  with  the  "bad-subjects"  group,  only  four  out 
of  eight  of  the  perceived  classifications  are  significantly 
different.   Based  on  the  perceived  classification,  there  is 
substantial  evidence  that  the  responses  from  all  the  subjects 
should  remain  in  the  analysis.   The  intended  classifications  are 
not  as  convincing.  However,  the  remaining  analysis  will  be 
performed  with  emphasis  on  the  perceived  classification.   Hence, 
there  is  no  reason  to  exclude  subjects'  responses  from  the 
analysis. 

Another  approach  to  data  reliability  is  consistency 
within  subjects.   Some  of  the  scenarios  that  were  used  were 
quite  similar.   However,  only  subjects  who  received  the 
fourth  package  of  scenarios  (see  Table  3-2)  were  exposed  to 
two  nearly  identical  scenarios,  E3  and  E4.   Both  E3  and  E4 
were  designed  for  the  change  to  be  the  deletion  of  a 
substitute  control  (an  unnecessary  batch  total),  but  E4's 
change  also  included  the  addition  of  a  complementary 
control.   Therefore,  subjects  who  received  package  four  had 
a  repeated  measure  of  questions  one  and  two  (the  only 
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questions  asked   before   the   change  was   recommended).     As  a 
result,    reliability  of    responses  could  be   inferred  if   there 
were  no  differences  between  these  answers  within   subjects. 
The  following  test  was  devised:    (1)    the  responses  of   all 
subjects  who  were  given  package  four  were  partitioned  into  a 
data   set;     (2)    the  difference   between  each   subject's  answers 
to  questions  one  and  two  was  computed  and  labeled  Dl  and  D2 
respectively;    (3)    the  average   of   Dl   was  computed  across  all 
subjects  in  the   partitioned  data   set,    and  an  identical 
process  was  followed  for   D2;    and    (4)    each   of   the  averages 
were   statistically  compared  to  zero.      In  neither   case    (Dl 
nor   D2)    was  the  average   difference   statistically  different 
from   zero    (Dl    z-score   =  0.188,    D2    z-score   ■  1.141)    at   alpha 
=  0.05.      As  an  added  test,    answers  were  averaged  across 
subjects  and  the  differences  in  the  averages  were   computed 
(rather    than  taking   the  average   of   the  differences).      Again 
the  differences  were  not   significantly  different  from  zero 
at  alpha   =   0.05    (question  one   z-score   «=   0.094,    question  two 
z-score  •=  0.815). 

Another   threat   to  the  validity  of   the  analysis  is  the 
distribution  of   responses  across  experimental   conditions. 
Because  100%   of   the  questionnaires  were  not   returned,   there 
might  be  an  unbalanced  distribution  of   scenarios  among 
independent   variables.      However,    such  was  not  the  case,    as 
is   shown  by   Table   5-7. 
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Table  5-7.      Distribution  of   Returned  Scenarios    by 
Independent  Variable 

Types  oj  cfrenges 
T  II  12  |3  |4  iTotal 

p  o  E|             41    I             39    I             43    |             45    |    168 

e   n  -+ + + + + 

st  P|              44    I              43    |             39    I             39    I    165 

r  -+ + + + + 

o  o  T    I             39    I             41    I             42    |             40    I    162 

f   1  -+ + + + + 

s  Total       124              123              124              124        495 


As  a  result  of  the  above  tests,  it  appears  that  there 
is  no  strong  systematic  reason  to  doubt  the  reliability  of 
the    subjects  or   data. 


Hypothesis  One 

The  first  hypothesis   tested   is  U^. 

HjJ      The  more  ambiguous  the  decision,    the  greater   the 
subject  will  rely  on  the  source  and  tone  of  the 
message. 

Clarity   in  a   business  decision  is  intended  to  mean  the 

predominance   of   benefits  over   costs  or  vice  versa.      By 

reading  the   scenarios,    the  changes  in  costs  and  benefits  of 

which  the  subjects  would  be  aware  are   the   increase 

(decrease)    in  the   internal   control   strength   and  the  increase 

(decrease)    in   cost   for    providing   control    changes.      An 

examination  of   the  changes  in  costs  and  benefits  associated 

with  each  type  of  change  permits  a   rough  assessment   of 

ambiguity.      Each   type   of   change   is  evaluated  in  terms  of 

changes  in   costs  and   benefits   in  Table   5-8. 
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Table  5-8.      Evaluation  of   Changes   in  Costs  and  Benefits   for 
Types  of   Changes 


TYPe  Ql  Change 

Add  a  Complement  Type-1 

Delete  a  Complement  Type-2 

Delete  a  Substitute  Type-3 


Change 
Intended     Perceived  in 
Lahsl  Label  Benefits 


A 
C 
D 


Replace  a 
Substitute  with 
a  Complement 


Type- 4 


increase 
decrease 
none 

increase 


Change 

in 

Costs 

increase 

decrease 

decrease 


little  or 
none 


An  examination  of  Table  5-8   indicates   that  the   two 
changes   "D"  and   "F"  are   unambiguously   cost-beneficial.      If 
subjects  acted  in  a  manner  consistent  with  Hi,    they   should 
have  allocated  less  points  to  source   and  tone  when  they 
answered  question  four   "D"  or    "F"  than  when   they  answered 
"A"  or  "C."     Hence,   the  test  for  Hx  was  that  the  average 
number  of  points   that   subjects  have  allocated  to   source  and 
tone  is  greater  for  "A"  or  "C"  than  for  "D"  or  "F."     if  sE- 
is   defined  as   the  average   points   allocated  to  £  and  ±  for 
subjects  who  answered  question  four    "i",   than  the  following 
relationships  should  hold:    elA  >  sED,    IEA  >  iEF,    s€c    >  IED, 
and  sEc   >  stp.      Table  5-9  contains  the  means  of   the  points 
allocated  to   source  and  tone,    classified   by  perceived  type 
of    change. 
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Table  5-9.      Mean  Points  Allocated  to  Source  and  Tone, 
Classified  by  Perceived  Type   of   Change 

Perceived  Type   of   Change 
A  £  J2  I 

Mean  36.2  24.9  39.4  32.7 

n  132  141  83  71 

Standard 

Deviation  25.5  22.9  26.9  26.4 


An  examination  of  Table  5-9   reveals   the  following 
ordering  of    the  means:   stA  >  sTD,    stA  >  stF,   IEC  >  5ED,    and 
sEc   >   sEp.     Three   of   the  four   comparisons  are   in  the  wrong 
direction.      Therefore,    Hj    is  not   supported.      One-tailed 
tests  of  difference  in  the  means  were  performed  to   determine 
if   the  differences  were   statistically  significant.      The  only 
difference   that  was  in  the   correct   direction,    sEA   >   sEp,   was 
not   statistically   significant    (z-score   =   0.911)    at  alpha   = 
0.05.      Two    (IEC  <  sED  and  sEc   <   sEF)    of   the   three 
comparisons  that  were  in  the  wrong  direction  were 
statistically   significant    (z-score    =   4.11    and    2.12, 
respectively)    at   alpha   =   0.05.      The   third    (sEft   <   sED) 
comparison  in  the  wrong  direction  was  not   statistically 
significant     (z-score    »    0.866). 

In  considering  why  Hj    is  not   supported,   an  alternative 
approach  was  also   used.     Subjects  were  asked  to  allocate 
one  hundred  points  among  four   factors  that  could  have 
influenced  their   decision.      One   of   the  factors  was  the 
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economic  cost-benefit  effect   of   the  change.     It  was  argued 
above  that  ambiguity  was  a  result  of  unclear  cost-benefit 
decisions.      Therefore,    subjects   should  allocate  more   points 
to  cost-benefit  for   those   decisions  that  are  clearly  cost- 
beneficial    ("D"  and    "F")    than  to   those   decisions   for   which 
the   cost-benefit   relationship   is   not    clear    ("A"  and    "C"). 
In  other  words,   subjects   should  recognize   that  their 
decisions  were  more  likely   to  be  based  on  a  cost-benefit 
argument  in  some   cases,    if   they  were.      To  be   consistent  with 
this  idea,    the  averages  of   points  allocated  to  cost-benefit 
by  subjects  should  be  as  follows:   cBD   >  cEA,   cBD   >  cEc,    cSF 
>  cEA,    and  cBF   >  cBc.   Table  5-10  present  the  average   number 
of   points  allocated  to   cost-benefit   classified  by  perceived 
change. 


Table  5-10.      Mean  Points  Allocated  to  Cost-Benefit, 
Classified   by  Perceived  Type   of   Change 


Perceived  Type   of   Change 
A.  £  J2  £ 

Mean  56.2  65.3  54.9  57.6 

n  132  141  83  71 

Standard 

Deviation  27.5  27.8  28.4  28.2 

An  examination  of   Table  5-10   indicates  that  cBD   }  cEA, 
cBD   }  cBc,    cBF   >  cEA,    and  cBF   }  cEc.      In  other  words,    the 
direction  is  inconsistent  with   the  hypothesis   that   subjects' 
decisions  were  made  mainly  on  a   cost-benefit  basis  when  the 
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cost-benefit  relationship  was   clear.      Therefore,      the  reason 
that  Hj    is  not   supported  is  that   subjects  did  not   consider 
cost-benefit  as  the  predominant  decision  factor  only  when 
the  cost-benefit  relationship  was  unambiguous. 

Hypothesis   Two 

H2:     There  will   be  no  difference  between  the  amount  of 
reliance   the   subjects   place  on  the    source    (either 
external   auditors  or   systems  analysts)   of   the 
criticism. 

One  way  to  test  for  a  statistical   relationship  between 
the   dependent  variables  and   the   independent  variable   source 
would  be   to  perform   analyses  of  variance    (ANOVAs)    for   each 
of   the   dependent  variables.     Twenty  ANOVAs  were 
performed  for   the  effects  of   the  independent  variables 
type   of   change,    type   of   control,    tone,    and   source  on 
each   of   the  dependent  variables.     Summary   results  are 
presented  in  Table  5-11   for   these  ANOVAs  performed  on 
data   classified  by  both   intended  and  perceived  types  of 
changes.      The  first  entry  in  Table  5-11,    6.31,    is   the   F- 
value   for    source   from   the  ANOVA  that  used  the  following 
model:      initial   internal   control   rating   =   c  +   t  +   s.      The 
entry   under   PR   >  F,    0.0123    ,    indicates  that  the  F-value   of 
source  was  statistically   significant  at  alpha   =  0.05.      The 
perceived  data   entries  used  the  same  model   except  perceived 
type   of   change    (answer   to  question  four)    was   used  in  place 
of    intended  type   of    change. 
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Table  5-11.      F-ValueB  and  Probabilities   of   Independent 
Variable   "Source",    from   ANOVAs  of    Independent  Variables  on 
Selected  Dependent  Variables 


Dependent 
Variables 

Initial 
IC-rating 

Importance 
of   IC 
Procedure 

Difference 

Overall 
Effect   of 
Change 

Recom- 
mendation 
to  Audit 
Committee 


Intended  Data 
F-Value        Bif 


Perceived  £a_£a 
F-Value       £2  2  £ 


6.31 

.95 
3.49 

.71 
.47 


.0123 

.3299 
.06  23 

.3995 
.4913 


4.73 

.95 
3.61 

1.07 
1.33 


.0301 

.3294 
.0579 

.3004 
.2494 


indicates  significance  at  alpha  •=  0.05 


Because  the  two  classes  of  source  (external  auditor  and 
systems  analyst)  were  designed  to  have  the  same  impact  on 
the  subjects,  it  was  expected  that  partitioning  the  subjects' 
answers  by  the  variable  "source"  would  not  result  in 
a  statistically  significant  effect.   However,  these  are 
measures  of  the  manipulated  variable  "source."  It  does  not 
mean  that  the  response  variable  "source"  (as  measured  by  the 
points  allocated  to  source  by  the  subjects)  was  not  a 
significant  factor  in  the  subjects'  decision  processes. 

It  can  be  seen  from  an  examination  of  Table  5-11  that 
only  one  dependent  variable  (the  subjects'  initial  rating  of 
internal  control  strength)  was  significantly  affected  by 
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the   type   of   source.      However,    the  initial   internal   control 
rating  was  made  before  the  outside   source  made  the 
recommendation.      Therefore,    the   significance   of   the 
independent   variable   "source"  on   the   subjects'    decisions  was 
merely  a   statistical   artifact.     An  ANOVA  which  included 
interactions  was  also  performed,    and  the  results  of   the 
interaction  between  type  of  change  and  source  was  not 
significant    (PR    >  F    =   0.4204).      In  other   words,    there   is 
good  supporting  evidence   in   favor    of   H2. 

H2  could  be  extended  to  imply     that   "source"  might 
interact  with   "type   of   change"   to   increase    (or    decrease)    its 
effect   on  the   subjects'    final    decisions.      There  are  no  a 
priori   expectations  for   this  extension  of   H2,   which  is 
purely   exploratory   in  nature.      One   could  predict   that  the 
average  recommendation    (variable    "decision")    classified   by 
type   of   perceived  change   would  become  stronger    (weaker)    if 
the  effect   of   the  external  auditor  was   greater    (less)    than 
that  of   the  systems  analyst.     Table  5-12  shows  the  expected 
effects  of   source   on   type   of    change. 
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Table  5-12.      The  Expected  Effects   of   Source  on  Average 
Recommendation  When  Classified  by  Type   of   Change 


Expected  Order 


Nature 

of 

Chanae 

Intended 
Type  of 
Chanae 

Subjects' 
Perceptions 

Assuming  External  Auditor 
Initial    Increases   Decreases 
Direction  Effect     Effect 

Add 

1 

A 

Positive 

EA>A>SA 

SA>A>EA 

Delete 

2 

C 

Negative 

SA>A>EA 

EA>A>SA 

Delete 

3 

D 

Positive 

EA>A>SA 

SA>A>EA 

Replace 

4 

F 

Positive 

EA>A>SA 

SA>A>EA 

Note:      EA  stands   for   External   Auditor 
SA   stands  for   Systems  Analyst 
A  stands   for   Average 


If   the  classified  averages  fell    in  the  predicted 
directions  under   either  assumption,    one  would  have  reason 
(if   not   a    statistically   significant   reason)   to   suggest  that 
the  external  auditor   or   the   systems  analyst  had  a   greater 
effect   on  the   subjects,   depending  on  which   set  of 
predictions  was   realized.      Figure  5-3  depicts   the  results 
of   the   interaction  of    source  and  type   of   change   on  subjects' 
decisions.      Table  5-13   presents  the  averages  of  d.   classified 
by   both   perceived  type    of   change   and  source. 
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+  4 


+3 


+  2 


+1 


-1 


-3 


-4 


SA, 


EA, 


*SA 


nEA 


SA 


EA 


SAJ 


EA 


Note: 

EA  =  External  Auditor 
SA  =  Systems  Analyst 
A  =  Average 


A        C         D         F 
Type  Si   Change 

Figure  5-3.   "Source"  Influence  of  the  Average  of  the 
Subjects'  Decisions  as  a  Function  of  Perceived  Change 
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Table  5-13.  Means  of  Average  of  Variable  "Decision" 
Classified  by  Perceived  Type  of  Change  and  Source  of 
Recommended  Change 


Perceived  Type 
of  Change 

(EA) 
External 
Auditor 

(SA) 
Systems 
Analvst 

(A) 
Overall 
Average 

Add  a 
Complement 

2.6 

2.4 

2.5 

Delete  a 
Complement 

-2.4 

-1.9 

-2.2 

Delete  a 
Substitute 

1.9 

2.3 

2.1 

Replace  a 
Substitute  with 
a  Complement 

2.7 

2.8 

2.7 

It  can  be   seen  from   Figure  5-3   and  Table   5-13   that  50% 
of   the  averages  are  consistent  with  the  assumption  that 
external  auditors  have   the   greater   impact    (type-1  and  type- 
2),   and  the  other  half   are  consistent  with  the  assumption 
that   systems  analysts  have   the   greater   impact    (type-3  and 
type-4).      This  is  consistent  with  H2,    that  alternative 
sources  have   no   systematic  effect   on   decision. 

An  ANOVA  of   the  form:   d  =  c+s+t+s*tr   indicated 
that  neither   the  independent  variable    "source"   nor    the 
interaction,   s.  *  s.,    was  significant   in  predicting  d.. 
Tone 

Another   independent  variable  was  tone.      The   tone   of   the 
recommended  change  was  manipulated  over   two  levels: 
strong  and  weak.      In  examining  tone,   attention  was  paid 
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to  two  aspects  of   the  manipulation.      First,    did  the   subjects 
notice  the  manipulation  of  tone?     Second,   did  tone,   as  an 
external  manipulation,    influence    the   subjects'    decisions? 

Two  approaches  were  used  to  test  the  question  of 
whether   the  subjects  attended  to  the  manipulation  of   tone. 
The  simplest  test  was  the  final  question  in  the  experimental 
instrument,   which  read    (for   those  receiving  external 
auditor    packages) 

Some  of   the  external  auditor's  recommendations  were 
stronger   than  others.     How    important   do  you   believe   the 
strength   of   the  recommendation  was  in  influencing  vour 
judgment?  J 

Answers  were  solicited  on  a   scale  of  very  important    (+4) 

to   not    important    (-4).      The   average  response   was   -0.72. 

Subjects  were  also  asked  to  allocate  one  hundred  points 

to  the  factors  which  influenced   their   judgment.      If   the 

manipulation  of   tone  were  successful,    one  would  expect  that, 
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n  the  average,   more   points  would   be  allocated   in   scenarios 
with  the  strong  manipulation  than  in  scenarios  with  weak 
manipulations.     All   responses  were   classified  into   strong 
and  weak   groups  according  to  the  intended  manipulations,    and 
the  allocation  of  points  to  tone  was   computed  for   both 
categories.      The  results  of   a  test   for   difference   in  means 
were   not   significant  at   the  alpha   =  0.05   level.      However, 
the   difference   is  in  the  predicted  direction.      The  results 
are   presented   below   in   Table   5-14. 
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Table  5-14.  Test  of  Difference  in  Mean  Points  Allocated  to 
Tone  When  Responses  are  Classified  by  Intended  Manipulation 
of  Tone 


Mean  Allocation  Standard  Error 

Manipulation        of   Points   to  Tone  of  jtivg  Mean 

Strong  10.72764228  .92210967 

Weak  9.65261044  .81310997 

Z-Score  ■  0.711266 


Hypothesis   Three 

H-j:      The  change  in  the  internal  control  ratings  will  be  a 

function  of    the   subject's   classification  of   the  type   of 
change,    as  is   specified   in   Table  3-4. 

This  hypothesis  can  be  restated  in  terms  of  the 

variable    "difference."     The    sign   of    the   variable 

"difference"   is  a   function  of    the   subject's   perception  of 

the   type   of   change    (answer   to  question   four).      Even   though 

there  were  four   intended  manipulations  of   type  of   change, 

the  subjects  were  given  the  option  of  selecting  one  of  six 

types  of    change    (A   through   F)    in   response    to  question  four. 

This  portion  of   the  analysis  will   be  performed  using  all    six 

possible  responses  because   there  is  no  more  reason  for 

excluding  the  two  answers  that  could  not  be  correct  (B  and 

E)   than  for   excluding  a  missclassif ied  response  which 

happened  to   be  one   of   the   possibly  correct  answers    (A,    C, 

D,    and  F).      Therefore,    expectations  for   the  value   of   the 

variable   "difference"  were   developed   in   all    six   cases    (see 

Table  5-15)  . 
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Table  5-15.   Expected  Values  of  the  Variable  "Difference" 
for  All  Perceived  Types  of  Changes 

Expected  Value  of 
Subject's  Perception  Variable  "Difference" 

A,  Add  a  Complement  Positive 

B,  Add  a  Substitute  Zero 

C,  Delete  a  Complement  Negative 

D,  Delete  a  Substitute  Zero 

E,  Replace  a  Substitute  with 

a  Substitute  Zero 

F,  Replace  a  Substitute  with 

a   Complement  Positive 

Given  the  expectations   in  Table  5-15,    it  is  easy   to 
formulate  a   statistical   hypothesis  for   each   type    of    change. 
For   all    six  cases  the  null   hypothesis  is  that   the  average 
value   of   the  variable    "difference"   is   zero.      For    the 
positive    (negative)    expected  values  the  alternative 
hypothesis  is   that  the  average  value   of   the  variable 
"difference"   is   greater    (less)    than   zero.      This   is  a   one- 
tailed  test,    and   the   t-score  and   z-score  rejection  values 
for   alpha  =   0.05   are  about   1.645    (exact   t-score  values   for 
each   sample   size  are   given  in  Table  5-16).      It  is   desirable 
to   reject   each   positive-type    (negative-type)   hypothesis  in 
favor   of   the  alternative  hypotheses.      For   the  zero  expected 
values,    the  alternative  hypothesis   is  that  the  average  value 
of   the  variable   "difference"  is  not   equal   to   zero.      This   is 
a   two-tailed  test,   and  the  z-score  rejection  value   for   alpha 
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=  0.05   is  1.96.      It  would   not   be   desirable   to   reject   the 
zero-type   hypotheses.      The  results  of   these   tests  are 
reported   in  Table    5-16. 

Table  5-16.      Tests  of    the  Variable   "Difference"  Classified  by 
Type   of   Change 


Type 

Expected 

Rejection 

of 

Value   of 

Sample 

Change 

"Difference 

"     Ha 

HfiSil 

£iZ£ 

Reaion 

Z-score 

A 

Positive 

X>0 

2.97 

132 

1.645 

13.966* 

B 

Zero 

X\0 

-1.46 

35 

2.042 

3.496* 

C 

Negative 

X<0 

-2.91 

141 

1.645 

16.027 

D 

Zero 

X^0 

-0.17 

83 

1.99 

1.232 

E 

Zero 

5^0 

-0.20 

25 

2.06 

.348. 

F 

Positive 

X>0 

1.79 

71 

1.71 

5.757 

^statistical    significance  at  alpha   =  0.05,    one-tailed   test 
statistical   significance  at  alpha  =  0.05,   two-tailed  test 


An  examination  of   Table  5-16   indicates   that  five   of   the 
six  means  are  consistent,   at   statistically  significant 
levels,    with   the  expected  values.      In  other  words,    the   three 
positive-type  and  negative-type   hypotheses  were  rejected  in 
favor   of   the  alternative  hypotheses,   and   two  of   the  zero- 
type  hypotheses  were  not   rejected.      The  only  nonsupportive 
case  occurred  when  one  of   the  zero-type  hypotheses  was 
rejected    (it  was  in  favor   of   the  general   hypothesis  to 
accept  the  zero-type  hypotheses  and   reject   the   others).      The 
"failed"   hypothesis  was  for   type   of   change  B,    add  a 
substitute.      No  explanation  for   this  answer  has   been 
devised.      If    the  average   of    the  variable   "difference"  for   B 
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had  been  positive,  than  one  might  put  forward  the 
possibility  that  the  addition  of  any  control,  even  a 
substitute,  might  increase  internal  control  strength. 
However,  the  average  was  significantly  negative.   The  author 
can  offer  no  explanation  for  why  the  addition  of  a 
substitute  might  decrease  internal  control  effectiveness. 


Path  Analysis 

The  fourth  hypothesis   is  a   test   of   the  five-variable 

path  analysis  model   developed  in   Chapter    IV.      In  order  for 

the  model   to   "fit",    H4   cannot   be   rejected. 

H4:   The   path  analysis  will    "fit",  i.e., 
rti.sc  ■  0   and   rsi.tc  "  0 
Hayes    [1973,   p.   711]    and  Steel    and  Torrie    [1960,    p. 

303]    give   the  formulations  for   partial   correlations    (see 

Appendix  F).      The   correlation  coefficients  in  Table  5-17   and 

the  formulations  in  Appendix  F  were   used  for  making  the 

computations  necessary  to  test  H4.     These  partial 

correlation  coefficients  are   also   reported   in  Table   5-17. 
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Table  5-17.   Correlation  Coefficients  For  Variables  in  the 
Path  Analysis  Model 

d      i      £      ^      i 

d  1         .080      .682  .216  .050 

i  1         .102  .039  -.094 

c  1  .152  -.014 

s  1  0.0 


t 


1 


rti.c  "  -.003.      rtsc  •=    .027,      ris#c  =    .077 
rti.sc   "  --005'      *8i.tc  =    .077 

Both  partial   correlation  coefficients  are  close   enough   to 
zero  to   say   that  the  model   fits. 

Another   test   of   a  path   analysis  model   is  to  decompose 
each   covariation  into  its   causal   and  noncausal   paths.      if 
this  can  be   done,    the  model    "fits"  and  the  computations  have 
been  done   correctly.      Table  5-19   is  a   decomposition  table 
for   the  five-variable  model  which  accounts  for  all  the 
covariation   using  the   techniques   specified   in  Table   4-5. 

One  of  the  problems  in  applying  path  analysis  to  the 
current  model   is   that  the  variable   type   of   change    (either 
perceived  or   intended)    is  not   on  an  interval   scale.      Two 
solutions   present  themselves:    (1)    use  a  surrogate  for   type 
of  change;   or   (2)   perform  a  path  analysis  within  each  type 
of   change,    and  compare  results  across   changes.      Both 
approaches  were  adopted.      A  list   of   the  variables  used  in 


c 

Type   of 
Change 

i 

Importance 

d 

Decision 
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the  path  analysis  and  the  source  of   the  data  used  to 
estimate   them    is  presented  in  Table  5-18. 

Table  5-18.     Variables  Dsed  in   Path  Analysis 

Abbreviation  Variable  Source  jj£  Variable 

s  Source  Points  allocated  to  source 

t  Tone  Residual   from   regressing  the 

points   allocated  to   source  on 
the  points  allocated  to  tone 

Difference  in  answers  to 
questions   3   and  1 

Answer   to  question  2 

Answer   to  question  7 

The   surrogate   used   in  place   of    "type   of   change"  was 
"difference"    (question   three   less  question  one).      This 
surrogation  reduces   the  variable   "type   of   change"  from   a 
four-level    class  variable  to  a   continuous  variable.      Each 
type   of   change  has  an  expected  effect  on  internal   control 
strength.      For  example,    an  add-a-complement  change  would 
result  in  an  increased  internal    control    rating.      Therefore, 
the  variable   "difference"  should  be   positive.      Moreover,    the 
greater   the   subject's  perception  of   the   improvement  in 
internal    control,    the   greater   the  variable  "difference* 
would  be.      Similar  observations  can  be  made  about   the   other 
types  of   changes:      (1)   delete  a   substitute  will    result  in  a 
zero  difference;    (2)    delete  a   complement  will   result  in  a 
negative   difference;    and    (3)    replace  a   substitute  with   a 
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complement  will   result  in  a  positive   difference.      However, 
there  is  a   loss  of    information  when   "difference"  replaces 
"type   of   change."     This   is   easily   seen   by   comparing   type-1 
and  type-4  changes.      Both  changes  result   in  positive 
differences   because   they  both  add  a   complement.     However, 
type-4  also  deletes  a   substitute.      Therefore,    assuming 
approximately  the   same  cost  for  both  added  controls,    type-4 
is  more  advantageous   because   of   the  cost   savings  associated 
with   deleting  the    unnecessary   control. 

Path  Model  for  All  Data 

The  method  outlined  in  Chapter  IV  was  used  to 
estimate  the  path  coefficients  utilizing  all  the  data  in  an 
unclassified  fashion.   A  decomposition  of  the  bivariate 
covariations  was  also  performed.  The  results  are  presented 
in  Figure  5-4  and  Table  5-19. 
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PdRv 


->  d  <- 


Pdi 


1  <- 


PiRu 


Structural  Equations 
i  =  picc  +  piuRu 

<3  =  Pds8  +  Pdtfc  +  Pdcc  +  Pdi1  +  Pdv^ 

Path  Values. 

Psc  -152  Pst  B-0  Ptc  "0-014 

Pds  -115  Pdt  -061  Pdc  '664 

Pic  -102  Pdi  -014  Prv  -720 
Pru  -995 


Figure  5-4.  Dnclassified  Path  Analysis  Model  Dsing  All  Data 
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Table  5-19.     Decomposition  of   Path   Coefficients   From 
Unclassified  All-Data   Model 


Bivariate 
Relation 

Total 
Covariance 

Causal 
Direct           Indirect 

Noncausal 

Xatal 

d    s 

.21635 

.11511 

none 

.10092 

.21603 

d  t 

.05019 

.06109 

none 

-.00901 

.05208 

d  c 

.68201 

.66396 

.00141 

.01663 

.68200 

d  i 

.08010 

.01386 

none 

.06918 

.08304 

i   c 

.10164 

.10164 

none 

none 

.1016  4 

To  understand  the  meaning  of   the  path  model  and 
decomposition  table,    the   paths  are   discussed  in  turn. 

The  path   between  source  and  decision,   pds,    has  a  value 
of  0.115.      If   it  were   not  for   the   unanalyzed  paths   between 
£,  i,    and  £,    an   interpretation  could  be  made  in  terms  of  a 
one-unit    (one   standard  deviation)   change   in  £  causing   a 
0.115-unit   change   in  d..      However,    the  unanalyzed  covariation 
among  independent  variables   prevents   this   because   the   causal 
relationship  among  the  independent  variables   is  unknown. 
Therefore,   the  indirect  effects  among  the  independent 
variables  are  also   unknown.    The  value   of   the  path   indicates 
that   source  is  second  only  to  type   of   change  in  influencing 
the   subjects'    decisions.      The  total   covariation  between  d. 
and  £  is  0.216.     Hence,  pds  is  53%   (.115/. 216)   of  the 
covariation. 

The  path  between  tone  and  decision,    pdfc,    has  a  value   of 
0.061,    which  is  about  half  as   important  as   source  and  next  to 
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the  last  in  overall    importance.      The  total   covariation  is 
0.052,   which   is  less   than  the   path   coefficient   by  0.009,    the 
noncausal   effect.      This  is  interesting  because  we   see   that 
the  noncausal   paths  can  serve   to  decrease   the   total 
covariation.      From   the   perspective   of   percentage   of   total 
covariation,    tone   is  more  important   than  type   of   change. 

The   path  between  type   of   change  and  decision,  pdc  has  a 
value   of   0.664,    which   is  97%  of   the  total   covariation  between 
d.  and  £.      Of   the  variables  examined,    this  one  has   the 
greatest   importance   in  determining  decision.     The  positive 
sign  of  the  path  can  be  interpreted  as  meaning  that  the 
larger    the   change   in  internal   control   strength    (brought 
about   by  a   change  in   controls),    the  larger   the   impact  on  the 
subject's  decision.      There   is  also   an   indirect   effect 
through   the  variable  that  measures  the   importance   of   the 
procedure  being  changed,   i.      This  indirect   cause  has  a  path 
value  of  only  0.001    (pic  x  pdi). 

The  path  between  i  and  d.  is  a  result  of  the  sum  of  two 
effects:    the  indirect  effect   of   change  acting  through  i  and 
the   independent  effect   of  i  on  d..      The  value   of   the  path  pdi 
is  only  0.014,    but   that   represents   16.8%   of    the   total 
covariation  between  d,  and  i.      This  variable  has  the  least 
impact   on  d.. 

In  order   of   importance   the  variables  are  £,  £,  i,   and 
1.      All   four  variables   are   directly  related  to  the  magnitude 
of    the   decision. 


118 


Path  Analysis:  Classified  by  Type  of  Change 

Path  coefficients  were  computed  for  subsets  of  the  data 
classified  by  perceived  types  of  change.   These  coefficients 
are  presented  in  Table  5-20.   The  results  of  the 
unclassified  model  have  been  included  for  ease  of 
comparison. 


Table  5-20.   Path  Coefficients  for  Classified  and 
Unclassified  Models 


Class 

Pds 

Pat 

Pdc 

Pdi 

All 

.115 

.061 

.664 

.014 

Add  a 
Complement 

.023 

-.088 

.239 

.189 

Delete  a 
Complement 

.053 

.121 

.286 

-.030 

Delete  a 
Substitute 

.020 

.009 

.186 

-.051 

Replace  a 
Substitute 
with  a 
Complement 

-.016 

-.169 

.233 

-.047 

Pic   PiRu  PdRv 


.102  .995  .720 

.429  .943  .773 

-.341  .976  .906 

.053  .999  .986 

.354  .939  .861 


To   simplify  the  analysis  of   the   data   in  Table  5-20,    it 
was  reduced  to  ordinal   data.     This  was  done   using  the 
absolute  value    (rather   than  the   signed  value)    to   prevent   the 
possibility   of    ranking  a  path  with  a  value   of   0.001   above  a 
path  of  -.350.      The   rankings  are   reported   in  Table  5-21. 
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Table  5-21.   Path  Coefficients  in  Order  of  Magnitude  by 
Perceived  Type  of  Change 

Classified  Models 


Replace  a 
Relative     Average  Substitute 

Rank  of       Over  All     Adda  Delete  a     Delete  a     With    a 


Path 

Types 

Comp. 

Comp. 

Sub. 

Com) 

Largest 

c(+) 

c(+) 

c(+) 

c(+) 

c(+) 

Largest 

s(+) 

i(+) 

t(+) 

i(-) 

t(-) 

Largest 

t(+) 

t(-) 

s(+) 

s(+) 

i(-) 

Largest 

i(+) 

s(+) 

i(-) 

t(+) 

s(-) 

abbreviations: 
comp.      complement 
sub.        substitute 

Note:   The   signs  of   the  coefficients  are  presented  in 
parentheses. 

Tables  5-20   and  5-21   can  be   examined  based  on  the 
changes  in  rankings   that  occur   as   the   paths  are  varied  by 
type   of   change. 

Add  a  complement  model,     in  this  model,  pdc  has  the 
largest  path  value,   as  it   does   in  all   the   other    classified 
models  and  in  the  overall   model.     However,    in  percentage 
terms    (comparing  the   second  largest   path   to  the  largest 
path)  it  is  much  smaller  in  the  classified  models  than  in 
the   overall   model.      In  the   overall   model,   pdi  was  the 
least   important   path.      In  this  model,   pdi   is  the  second 
largest   path,    and  it  is  very  close  to  the  largest   in 
percentage   terms.      In  the  overall    model,    the   second 
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largest  was  17%  as  large  as  the  largest.      In  this  model,   the 
second  largest   is  79%   as  large  as  the  largest   path.      In  the 
overall  model  the  indirect  effect  of  £  through  i  on  ^  was 
(0.014  x  0.102  =)    0.001.     in  this  model,  the  indirect  effect 
is   (0.189  x  0.429  =)   0.081,  which  is  close  to  being  as  large 
as   the   third  largest   direct   path.      The  path  for   tone,    pdt, 
did  not  change  much  in  magnitude  in  this  model   compared  to 
the  overall   model,    but   the  sign   changed,    an  indication 
that  the  more  important  the  tone  was,  the  less  likely  the 
decision  was  to  be   positive.      The   sign  of   this  path   is 
consistent  with  the   unexplained  inverse  relationship  between 
tone  and  decision  that  was  discussed  above.      Finally,    pd_ 
dropped  from   second  largest   to  an  ineffective  fourth  place 
in  this  model. 

Delete  a  complement  model.     The  most  interesting  aspect 
of   this  model   is   the   signs  of  p^   and  p^c.      Both   are 
negative.      The  value   of   the   signs  means  that  the  independent 
influence   of  i  is  inversely  related  to  d.,   while   the  indirect 
influence   of  £  through  i   is  positive    (indirect  effect  =  pdi 
x  pic'    B0   that  tnese   two  effects  work  against   each   other. 
However,    the   indirect   effect   is   small    (-0.03   x   -0.3  41   ■ 
0.010)  relative  to  the  effect  of  i,  -0.03.     In  terms  of 
rankings  this  model    is  nearly   identical   to  the  overall 
model.      Only  jfc  and  je  are   reversed. 

Delete   a   substitute   model.      In  this  model,    pdi    is 
negative,  as  in  the  delete  a  complement  model,  but  pic  is 
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positive.   This  has  the  effect  of  making  both  "independent 
importance  of  the  procedure"  and  the  indirect  effect  of  s. 
through  i  inversely  related  to  d.  while  the  other  independent 
variables  are  directly  related.   The  size  of  the  paths  in 
this  model  is  approximately  the  same  as  in  the  other 
classified  models.   The  rankings  of  the  paths  in  this  model 
are  similar  to  the  add  a  complement  model  with  the  .£  and  s. 
reversed. 

Replace  a  substitute  with  a  complement  model.  The 
signs  of   pdt,  pds,  pdi,  and  pic  in  this  model  are  negative 
as  are  pdi  and  pic  in  the  delete  a  substitute  model  and  pdt 
in  the  add  a  complement  model.  However,  the  sign  of  pd  is 
negative  for  the  first  time.   Hence,  the  only  positive  path 
affecting  £  is  pdc,  which  is  also  the  largest.   In  this 
model,  as  subjects  placed  greater  emphasis  on  the  effects  of 
£,  i,  and  i,  they  tended  to  reject  the  proposed  change.   On 
the  other  hand,  as  the  subjects  perceived  increases  in 
internal  control  strength  (brought  about  by  proposed 
changes)  they  tended  to  recommend  accepting  the  changes. 
Chapter  Summary 

The  analysis  of  the  results  in  this  chapter  are  divided 
into  two  groups  of  tests:  (1)  background  analysis  and  (2) 
hypothesis  testing  and  path  analysis.   In  the  background 
analysis,  it  was  shown  that  missclassif ied  data  could  be 
included  with  other  data  without  systematically  distorting 
the  results.   It  was  also  shown  that  the  inclusion  of  data 
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from  low   reliability  subjects  had  no  systematic  impact  on 
the  results.      A  repeated  measures  test   indicated  consistency 
within  subjects.      It  was  decided  that  the  interpretation  of 
the   data   based  on  the   subjects'   perception  of   the 
manipulated  variables  would  be  different  than  an 
interpretation   based  on  the  intended  manipulation. 

The  first  hypothesis    (subjects'    decisions  would   be 
contingent   on  the  degree  of   ambiguity   in  the   scenario's  cost- 
benefit   data)    was  not   supported.      The   second   hypothesis 
(source   credibility)    was   supported.      The  third  hypothesis 
(consistency  between  the  variable   difference  and  expected 
effects  of   perceived  type   of   change)    was   supported.      The 
fourth  hypothesis    (fit   of   the   path  analysis  model)    was 
supported. 

The  path  analysis   section  showed  that  the  variable 
"type   of   change"  was   the   leading   factor   in   the   subjects' 
decisions.      Classifying   the   data  within   "types  of   changes" 
resulted  in  different  path  models,    which  indicated  that  the 
average   decision  model   was   contingent   upon  the  "type  of 
change". 


CHAPTER  VI 
SUMMARY  AND  CONCLUSIONS 


This  chapter  has  four  sections:  (1)  a  summary  of  this 
research,  (2)  the  conclusions  and  implications  that  were 
drawn  from  the  analysis,  (3)  the  limitations  of  the  study, 
and  (4)  suggestions  for  further  research. 

Summary 
This  study  explored  some  of  the  factors  that  influence 
the  actions  of  managers  of  internal  control  systems.   In 
Chapter  I  the  line  of  authority  between  the  board  of 
directors  and  the  internal  audit  group  was  established.   It 
was  concluded  that  while  the  audit  committee  had  ultimate 
responsibility  for  the  system  of  internal  controls,  the  day 
to  day  management  of  the  system  was  the  duty  of  the  internal 
audit  group.   That  is  not  to  say  that  the  internal  audit 
group  performs  all  the  internal  control  duties.   Rather,  the 
internal  audit  group  has  responsibility  to  insure  that  the 
system  is  operating  correctly  and  to  evaluate  and  implement 
changes  in  the  system.  The  scope  of  the  study  was  limited 
to  studying  the  following  factors  which  influence  internal 
auditors  who  in  turn  must  evaluate  changes  recommended  by 
external  auditors:  cost-benefit,  source,  tone,  and 
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the  importance  of  the  procedure.   Motivations  for  the  study 
were  found  in  the  increasing  importance  of  corporate  audit 
committees,  the  FCPA,  and  the  impact  of  EDP-related  fraud. 

In  Chapter  II  the  assumption  was  made  that  internal 
control  judgments  are  based  primarily  on  cost-benefit 
considerations.  Chapter  II  included  a  literature  review  of  the 
following  areas:   external  auditors'  reliance  on  internal 
auditors'  work,  auditors'  ability  to  make  internal  control 
judgments,  and  source  credibility.   The  chapter  concluded 
with  a  general  model  of  factors  influencing  internal 
auditors'  responses  to  external  criticism  of  the  system  of 
internal  controls. 

Chapter  III  included  a  general  model  of  corporate 
behavior,  a  description  of  the  experimental  design  and  task, 
a  description  of  the  subjects,  and  the  pilot  testing 
procedures.   The  three  hypotheses  developed  in  Chapter  III 
were: 


Hj:   The  more  ambiguous  the  decision,  the  greater  the 
subject  will  rely  on  the  source  and  tone  of  the 
message. 


H2:   There  will  be  no  difference  between  the  amount  of 
reliance  the  subjects  place  on  the  source  (either 
external  auditors  or  systems  analysts)  of  the 
criticism. 


H3:   The  change  in  the  internal  control  ratings  will  be  a 

function  of  the  subject's  classification  of  the  type  of 
change,  as  is  specified  in  Table  3-4. 


125 


Chapter  IV  was  devoted  to  a  review  of  the  principles  of 
path  analysis  and  the  combination  of  Chapter  II's  general 
model,  the  variables  described  in  Chapter  III,  and  the  path 
analysis  methods  in  Chapter  IV.   A  five-variable  model  was 
described,  and  a  test  of  the  model's  fit  was  proposed. 
Hypothesis  H4,  a  test  of  the  degree  of  "fit",  specified  two 
partial  correlation  coefficients  which  would  be  expected  to 
equal  zero,  if  the  model  "fit." 

Chapter  V  was  devoted  to  analysis  of  the  results.   It 
was  divided  into  two  major  groups  of  tests:  (1)  background 
analysis  and  (2)  hypothesis  testing  and  path  analysis.   The 
background  analysis  established  several  things.   First, 
missclassified  data  were  compared  to  "all-data"  and  subsets 
0f  "all-data".   It  was  decided  that  the  missclassified  data 
did  not  have  a  statistically  significant  impact  overall. 
Second,  the  reliability  of  some  of  the  subjects  was 
questioned.   However,  tests  indicated  that  the  inclusion  of 
the  low  reliability  subjects'  data  had  no  systematic  impact 
on  the  results.  The  decision  was  made  not  to  exclude  the 
subjects  identified  as  potentially  unreliable.   Subject 
reliability  was  also  tested  with  a  repeated  measures  test, 
which  indicated  consistency  within  subjects.  Third,  when 
asked  to  classify  the  experimentally  manipulated  variables, 
the  subjects  indicated  a  different  perception  of  the 
scenarios  than  was  intended.   It  was  felt  that  the  data 
would  be  interpreted  differently  if  it  were  classified  by 
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perceived  rather  than  intended  manipulations.   The  upshot 
was  that  classification  by  subjects'  perceptions  caused 
results  to  be  more  consistent  with  prior  expectations  than 
did  classification  by  intended  manipulation.   Hence,  it  was 
decided  to  emphasize  perceived  classifications  of  the  data 
for  the  remainder  of  the  analysis. 

The  other  major  group  of  tests  consisted  of  hypothesis 
testing  and  path  analysis.   The  first  hypothesis  expressed 
the  view  that  the  subjects'  decision  models  would  be 
contingent  on  the  degree  of  ambiguity  of  cost-benefit  data 
in  the  scenarios.   This  hypothesis  was  not  supported. 
Subjects'  reliance  on  source  and  tone  did  not  vary  with  the 
ambiguity  of  the  scenarios. 

The  second  hypothesis  was  concerned  with  source 
credibility.  The  experiment  was  designed  so  that  external 
auditors  were  the  source  of  the  recommended  changes  in 
internal  control.   However,  to  insure  that  any  equally 
credible  source  would  have  the  same  results,  half  the 
subjects  were  given  recommendations  from  systems  analysts. 
H2  was  supported:  statistically  the  subjects  responded  the 
same  for  either  source. 

Several  tests  were  performed  on  the  independent 
variable  "tone."  On  average,  subjects  thought  that  the  tone 
of  the  recommendation  was  about  halfway  between  "very 
important"  and  "not  important"  on  a  nine-point  scale. 
Subjects  allocated  more  points  to  tone  for  the  strong-tone 
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group  than  for   the  weak-tone   group.     However,    the   difference 
between  strong-tone  and  weak-tone  was  not   statistically 
significant.     When  tone  was  an  independent  variable  in  an 
ANOVA  with   decision  as  the  dependent  variable,    tone  was  not 
significant.     However,    the  interaction   between  tone  and   type 
of   change  was   statistically  significant.      The  interactions 
between  tone  and  each  type  of  change  were  examined 
graphically   and  statistically.      A  trend  was  obvious, 
especially  for   the   types  of    change   classified   by   subjects' 
perceptions.      Within  types  of   change,    tone  had  an  inverse 
relationship  with   decision.     No  explanation  was   offered  for 
this   phenomenon. 

The  third  hypothesis  predicted  that  the  variable 
difference  would  be  consistent  with  the  expected  effects  of 
perceived  types  of  change.  Six  types  of  change  were  used  in 
this  analysis  because  the  analysis  depended  only  on  what  the 
subjects  perceived.  Only  one  of  the  six  classifications  was 
not  in  the  predicted  direction,  and  only  one  of  those  in  the 
predicted  direction  was  not   statistically  significant. 

The  fourth  hypothesis,    which   dealt  with   the   "fit"  of 
the  path  analysis  model,    was  supported.      The  path   analysis 
was  performed  on  all  the  data.     It  was  felt  that  the  use  of 
the  variable   "difference"   in   place   of    "type    of    change" 
resulted  in  a  loss   of   information.      Therefore,    the  path 
analysis  was  repeated  for   subsets  of   data  classified  by 
types  of   change.      In  the   unclassified  path  analysis   the 
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perceived  change  in  internal  control,  which  was  a  surrogate 
for  type  of  change,  was  the  most  important  factor  in  the 
subjects'  decisions  (recommendations  to  their  audit 
committees).  The  next  most  important  factor  was  source. 
Even  though  varying  the  source  had  no  effect  on  decision,  as 
expected,  the  subjects  considered  source  in  their  decision 
process.  Tone  was  also  considered.  As  earlier  results 
indicated,  the  relation  between  tone  and  type  of  change  was 
inverse.   In  this  model,  the  factor  "importance"  was  not 
found  to  be  salient.   However,  it  was  not  eliminated  from 
the  model  because  it  became  salient  in  subsequent  models. 
In  general,  the  unclassified  model  explained  48%  of  the 
variance  in  the  model. 

Recomputing  the  path  coefficients  for  data  classified 
by  type  of  change  showed  several  things.   The  classified 
models  were  different  enough  from  the  unclassified  models  to 
indicate  that  information  was  lost  by  replacing  type  of 
change  with  the  variable  "difference."  Factors  that  were 
unimportant  in  the  unclassified  model  became  relatively 
important  in  the  classified  model.   Finally,  the 
classification  of  data  resulted  in  changes  in  the  signs  of 
path  coefficients. 

Conclusions  and  Implications 
The  conclusions  of  this  study  are  subject  to  the 
limitations  which  are  detailed  below.   One  of  the  major 
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limitations  is  that  the  results  may  not  be  generalizable 
beyond  the  subjects  and  experimental  setting  of  this  study. 

The  subjects  did  not  distinguish  between  the  two 
sources,  external  auditors  and  systems  analysts.   In  other 
words,  subjects  attributed  the  same  level  of  professionalism 
and  expertise  to  either  source.   This  implies  that  internal 
auditors  do  not  view  external  auditors  as  a  source  of 
"gratuitous"  criticism,  made  only  because  it  is  expected. 

The  subjects  responded  to  tone  classified  within  type 
of  change  in  an  inverse  fashion.   In  other  words,  as  tone 
increased  within  a  type  of  change,  the  subjects  were  less 
and  less  predisposed  to  make  the  proposed  change. 
The  obvious  conclusion  is  that  current  understanding  of  the 
subjects'  motives  is  inadequate  to  predict  the  observed 
behavior.   The  unclassified  path  model  gives  no  indication 
of  this  inverse  relationship.  However,  the  unclassified  model 
does  not  adequately  account  for  type  of  change.   On  the 
other  hand,  when  individual  path  models  are  prepared,  two  of 
the  pdt  values  become  negative.   Also,  the  pdt  values  are 
relatively  larger  in  the  classified  models  than  in  the 
unclassified  models,  which  implies  that  the  classified  Pjts 
had  a  canceling  effect  in  the  unclassified  model. 

Examination  of  the  unclassified  path  model  leads  to  the 
conclusion  that  the  "difference"  in  reliability  contributed 
by  the  internal  control  change  is  overwhelmingly  the  most 
important  factor  influencing  the  subjects'  decision.   It 
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appears  to   be   close   in  value   to  the   total   unexplained 
effects    (0.664   compared  with   0.720).      However,    this   is 
misleading.     When  type  of  change  is   separated  from 
difference   in  the  classified  path  models,   the  effect   of 
difference  is  approximately  1/3  as  large  as   in  the 
unclassified  path   models.      The   path  value   for    "difference", 
pdc,    in  the   classified  path  models  explains  only  the  effects 
of    the   subjects'    relative  evaluation  of   the  importance   of 
the   change  on  internal   control  without   cost   information. 
The  results  of   this   study  have   implications  for  the 
actions  of  various   groups.     If   future  research  would  permit 
greater   external   validity,    one  could  make  the  following 
conclusions.      External   auditors   should  not  rely  on  varying 
the  tone   of   their  management  letters  in  order   to  elicit 
different  responses  from  management.      This  method  appears  to 
have   unpredictable   consequences.      On  the  other   hand, 
changing  the  context  of  a  management  letter   to  emphasize   the 
increase   in   internal    control   effectiveness    (type   of   change) 
would  appear  to  be  an  excellent  way  to  increase   or   decrease 
the  impact   of   a  management  letter.      When  adding  a  control, 
detailing  the  importance   of   the   procedure   being  changed  is 
also  very  effective.      Emphasis  on  the  position  of   the  person 
who  is  writing  the  letter  is  necessary  when  attempting  to 
persuade  management  to  make  a  change  that  cannot  be 
justified  on   other    grounds. 
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From  an  internal  auditor's  point  of  view,  the  results 
indicate  a  high  level  of  professionalism.  Decisions  were 
made  based  on  the  impact  that  changes  had  on  internal 
control,  almost  without  regard  to  source  or  tone.   The 
unexpected  results  of  Hj  (subjects'  decisions  are  contingent 
on  the  ambiguity  in  the  scenario)  may  be  due  to  limitations 
of  this  study  rather  than  to  a  lack  of  understanding  by 
internal  auditors  or  to  the  incorrectness  of  the  hypothesis. 
This  conclusion  is  based  on  the  existence  of  contradictory 
evidence.   Subjects  reported  that  they  did  not  key  their  cue 
weightings  to  their  cost-benefit  evaluation,  but  they  acted 
as  though  they  did.   There  may  have  been  some  confounding 
between  costs  and  benefits  that  may  explain  this  phenomenon. 
Costs  were  unknown,  while  the  benefits  of  each  change  were 
specific  but  intangible. 

If  these  findings  can  be  generalized,  audit  committees 
could  conclude  that  they  could  treat  their  internal  audit 
group's  evaluation  of  proposed  changes  with  confidence.   The 
audit  committee  should  not  fear  that  the  source  of  the 
management  letter  will  have  an  undue  influence  on  internal 
auditors  because  internal  auditors  reacted  the  same 
regardless  of  whether  the  source  was  the  external  auditor  or 
the  systems  analyst. 

Limitations  of  The  Study 
This  study  can  best  be  characterized  as  a  field 
experiment  without  the  benefits  of  a  laboratory  setting. 


132 


For   such   studies,    Campbell  and  Stanley    [1963,    p.    8]    list 
eight   possible   threats  to   internal   validity:    (1)    history, 
(2)    maturation,    (3)    testing,    (4)    instrumentation,    (5) 
regression,     (6)    selection,     (7)      mortality,    and    (8) 
interaction  between   selection,    maturation,   etc.      Each   of    the 
threats  to  internal   validity   will   be   considered  in  turn.      It 
might  be   tempting  to  discount  history  because   this 
experiment   was  administered  as  a  questionnaire.      However,    in 
one  pilot  test  subjects  were   particularly  interested   in  a 
scenario  because   they  had  recently  had  experiences  with  the 
type   of   problems   illustrated   in  the   scenario.     This  might 
have  caused  a  history-like  effect.      However,    any  history 
effects  should  have   been  averaged  out   because   the   sample 
size  was  large   and  the  subjects  were  assigned  at  random   to 
the   treatments.      The  amount  of   time  required  to   complete   the 
experimental   task,   approximately  30  minutes,   was  short 
enough  to  eliminate  any  concerns  about  maturation.     Testing 
factors    (fatigue   or   learning)    might  have  had  an  impact. 
However,    the  order   of   the  scenarios  was  systematically 
varied  and  randomly  assigned  to   subjects.     Instrumentation 
was  not  a  problem.     Regression  was  not  a   problem   because 
predicted  directions  were  always  more  extreme,    rather   than 
less  extreme.      Selection  offers   two  potential    threats. 
First,   only  a  portion  of   the  desired  population  made   itself 
available  for    selection.      Second,    there  is  a   possibility  of 
non-response   bias.      In  other   words,    the  particular   group  of 
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subjects  who  were  selected  (or  allowed  themselves  to  be 
selected)  may  have  made  up  a  disproportionate  share  of  the 
non-respondents.   Mortality  is  not  considered  a  threat 
because  of  the  length  of  the  experiment.   However,  mortality 
may  have  interacted  with  selection  to  contribute  to  any  non- 
response  bias. 

This  study  is  viewed  as  an  initial  exploratory  effort 
with  little  pretense  at  external  validity.   The  subjects 
were  not  selected  without  bias  from  all  possible  subjects. 
Furthermore,  some  subjects  may  have  been  included  who  should 
not  have  been.   For  example,  only  the  more  academically 
oriented  members  of  NAA  may  have  completed  the  experimental 
task.   The  experimental  task  was  very  narrow  in  scope,  and 
some  types  of  changes  were  relatively  unrealistic  (delete  a 
complement).   The  experimental  setting  was  foreign  to  the 
task.   Only  a  limited  number  of  treatments  were  varied,  and 
the  range  within  which  these  treatments  varied  was  narrow 
and  not  necessarily  representative.   In  other  words,  the 
results  of  this  study  should  not  be  generalized  beyond 
either  the  experimental  setting  or  the  actual  subjects  who 
responded. 

Suggestions  for  Future  Research 
Suggestions  for  future  research  come  from  the 
literature  review  as  well  as  from  the  results  of  the 
experiment.   The  professional  judgment  ability  literature 
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suggests  that,  as  the  complexity  of  a  task  increases, 
judgment  consensus  decreases.   This  should  be  explored  while 
controlling  for  or  considering  task  overloading.   Evaluation 
of  internal  controls  is  a  multiple  step  process,  and  the 
identification  of  the  complexity  of  each  step  requires 
additional  descriptive  research. 

Empirical  evidence,  other  than  antecedent  evidence,  of 
the  audit  committee's  relationships  with  the  internal  and 
external  auditors  should  be  explored  to  verify  that  the 
procedures  followed  by  audit  committees  are  consistent  with 
the  procedures  that  should  be  followed  and  with  those  which 
the  committees  claim  to  be  following. 

Descriptive  research  needs  to  be  done  to  discover  the 
weight  auditors  (internal  and  external)  apply  to  cues  in 
evaluating  internal  controls.   Along  the  same  line, 
descriptive  research  should  be  pursued  to  determine  the 
differential  weights  used  by  auditors  for  cost  and  benefit 
data  in  making  a  decision.   Furthermore,  it  would  be 
interesting  to  know  if  auditors  used  the  same  weighting 
scheme  for  cost  (benefits)  to  themselves  versus  costs  to 
others.   Finally,  the  usefulness  to  external  auditors  of 
utilizing  internal  auditors  for  some  audit  work  should  be 
explored  from  both  the  external  auditor's  and  management's 
points  of  view. 


APPENDIX  A 
INSTRUCTIONS  FOR  SUBJECTS 


The  next  four  pages  contain  xerographically  reduced 
copies  of  the  two  sets  of  instructions  which  were  given  to 
subjects.   The  first  two  pages  contain  the  instructions  for 
subjects  who  received  the  "external  auditor"  treatment.   The 
second  set  of  instructions  was  for  subjects  who  received 
the  "systems  analyst"  treatment. 
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Below  is  a  description  of  the  task  you  will  be  asked  to 
perform.  Its  focus  relates  to  how  individuals  evaluate  internal 
control  systems,     you  will  be  asked  to  sake  judgments  relating  to 
specific  internal  control  procedures  in  four  companies.     For  each 
of  the  four  companies,  please  assume  the  following: 

1.  Tou  are  the  new  internal  audit  manager. 

2.  Tou  have  just  been  hired  from  outside  the  company. 

3.  The  company's  external  auditors  have  recently  submitted  a 
management  letter  at  the  completion  of  their  audit. 

4.  The  management  letter  includes  a  recommended  change  in  the 
Internal  control  system,  which  has  been  included  under  the 
heading  of   "EXTERNAL  auditor's  recommendation." 

Tour  taski 

On  the  next  page  is  s  description  of  a  basic  corporate  structure 
which  is  common  to  four  companies.     For  each  of  the  four  companies. 
Alpha,   Beta,    Gamma,   and  Delta,   specific  Internal  control  procedures 
are  described.     For  each  of  the  four   companies: 

1.  Evaluate  the  Internal   control  procedures  described. 

2.  Answer  questions  about  each  company's  Internal  control 
procedures  independently.     In  other  words,   the  facts  of  one 
company's  procedures  should  ROT  affect  your  answers  to 
questions  about  the  other  companies'   procedures. 

3.  Each  change  involves  one  or  two  controls.     Controls  can 
be  loosely  classified  into  two  groups: 

(a)  desirable  controls-  those  controls  that  correct  a 
weakneas  in  the  Internal  control  procedure,  and 

(b)  undesirable  controls-  those  controls  that  fail  to 
correct  a  weakness  in  the  internal  control  procedure, 
Including  redundant   controls. 

Tou  will  be  asked  to  classify  each  change  as  one  of  the 
following: 

a.  addition  of  a  desirable  control 

b.  addition  ef  an  undesirable  control 

c.  deletion  of  a  desirable  control 

d.  deletion  of  an  undesirable  control 

e.  a  simultaneous  deletion  of  an  undesirable  control 

AHE  the  addition  of  an  undesirable  control 

f.  a  simultaneous  deletion  of  an  undesirable  control 

1MB  the  addition  of  a  desirable  control 

Confidentiality: 

All  of  your  answers  will  be  kept  completely  confidential. 

There  la  no  specific  time  limit,  but  it  la  expected  that  it 

will  take  you  about  a  half  hour. 
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Baiic  Corporate  structure 

This  corporate  structure  la  common  to  Alpha,   Beta,    Gemma,   and  Delta 
companies. 

Tour  company  la  one  of  the  largest  aanuf acturera  of  aen'a 
clothing.  Tour  coapany  began  ualng  a  computer-baser!  accounting  system 
to  assist  aanageaent  IB  years  ago.     It  vaa  one  of  the  first  aen'a 
clothing  aanufacturera  to  begin  to  use  computers.      Hoat  of  the 
programs  in  the  system  were  developed  by  your  own  highly  efficient 
prograaaing  team.     The  coapany  owned  its  computer  system  f roa  the 
start  and  has  kept  pace  with  hardware  developments.     Also,    the  coapany 
baa  been  careful  to  aaintaln  a  large,   competent  prograaaing  staff 
which  updatea  the  programs  to  accommodate  hardware  changes  and 
develops  changes  required  by  aanageaent  to  improve  service. 

Tour  coapany  licenaea  many  of  ita  programs  to  other  manufacturers 
through  the  trade  association.     This  has  two  major   benefits:   the 
revenue  earned  helps  to  defray  prograaaing  coats,    and  the  accuracy  and 
reliability  of  the  prograaaing  is  verified  by  its  use  in  other 
coa panics. 
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Below  is  *  description  of  the  tack  you  will  be  •eked  to  perform. 
Its  focus  relates  to  how  Individuals  evaluate  Internal  control 
systems.     Tou  will  be  asked  to  aake  Judgments  relating  to  specific 
internal  control  procedures  in  four  companies.     For  each  of  the  four 
companies,   please  assiute  the  following: 

1.  >ou  are  the  new  Internal  audit  manager. 

2.  Tou  have  just  been  hired  from  outside  the  company. 

3.  The  organisational  design  requires  that  you  report 
directly  to  the  board  of  director's  audit  committee. 

4.  Cach  year  the  controller,  who  reports  to  the  company 
president,   employs  an  outside  systems  analyst  to  review 
the  system  of  Internal  controls.     The  most  recent 
analyst's  report  Includes  a  recommended  change  in  the 
Internal  control  system,   which  has  been  Included  under 
the   heading  of    'SYSTEMS   ANALYST'S   RECOMMENDATION.* 

Your   task: 

On  the  next  page  is  s  description  of  a  basic  corporate  structure 
which  is  common  to  four  companies.     For  each  of  the  four   companies, 
Alpha,   Beta,   Gamma,   and  Delta,  specific  internal  control  procedures 
are  described.      For  each  of  the  four   companies: 

1.  Evaluate  the  internal  control  procedures  described. 

2.  Answer  questions  about  each  company's  Internal  control 
procedures  Independently.      In  other  words,   the  facte  of  one 
company's  procedures  should  ROT  affect  your  answers  to 
questions  about  the  other  companies'  procedures. 

3.  Bach  change  involves  one  or  two  controls.     Controls  can 
be  loosely  classified  into  two  groups: 

(a)  desirable  controls-  those  controls  that  correct  a 
weakness  in  the  internal  control  procedure,  and 

(b)  undesirable  controls-  those  controls  that  fail  to 
correct  a  weakness  in  the  Internal  control  procedure, 
including  redundant  controls. 

Tou  will  be  asked  to  classify  each  change  as  one  of  the 
following: 

a.  addition  of  a  desirable  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  a  desirable  control 

d.  deletion  of  an  undesirable  control 

«.  a  simultaneous  deletion  of  an  undesirable  control 
in  the  addition  of  an  undesirable  control 

f.  a  simultaneous  deletion  of  an  undesirable  control 
AMD  the  addition  of  a  deairable  control 

Confidentiality: 

All  of  your  answers  will  be  kept  completely  confidential. 

Time: 

There  la  no  specific  time  limit,  but  it  la  expected  that  it  will 
take  you  about  a  half  bour. 
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Basic  Corporate  Structure 

This  corporate  structure  is  common  to  Alpha,    Beta,    anna,   and 
Delta    companies. 

Tour  company   is  one  of  the  largest  aanuf acturers  of  Ben'* 
clothing.   Tour  company  began  uaing  a  computer-based  accounting  system 
to  aaslst  management  18  years  ago.     It  was  one  of  the  first  Ben's 
clothing  Banufacturers  to  begin  to  use  computers.      Host  of  the 
programs  In  the  system  were  developed  by  your  own  highly  efficient 
programming  team.     The  company  owned  its  computer  system  from  the 
start  and  has  kept  pace  with  hardware  developments.     Also,   the  company 
has  been  careful  to  maintain  a  large,    competent  programming  staff 
which  updates  the  programs  to  accommodate  hardware  changes  and 
develops  changes  required  by  management  to  improve  service. 

Tour  company  licenses  many  of  its  programs  to  other  Banufacturers 
through  the  trade  association.     This  has  two  aajor  benefits:  the 
revenue  earned  helps  to  defray  programming  costs,    snd  the  accuracy  and 
reliability  of  the  programming  is  verified  by  itr   use  in  other 
companies. 


APPENDIX  B 
SCENARIOS 


The  next  29  pages  contain  xerographically  reduced 
copies  of  some  of  the  scenarios  used  in  the  experimental 
instrument.   Each  scenario  has  a  five-character  designation 
and  a  page  number  at  the  top  of  the  page.  Most  scenarios 
are  two  pages,  long  but  a  few  are  three  pages  long.   The 
first  two  characters  of  the  designation  indicate  whether  the 
external  authority  was  an  external  auditor  (CI)  or  a  systems 
analyst  (Ca).   The  next  character  designates  the  type  of 
control  being  changed  (T,  E,  or  P).   The  fourth  character 
designates  the  type  of  change  being  recommended  (1,  2,  3,  or 
4).   The  last  character  designates  the  tone  of  the 
recommendation  (s  or  w). 

The  scenarios  are  divided  into  three  sections.   The 
first  nine  pages  contain  a  typical  package  of  four  scenarios 
(ClT3s,  ClE4s,  ClPlw,  and  ClP2w).   The  second  section 
contains  an  example  of  a  systems-analyst  scenario  (Caplw). 
The  final  section  contains  one  of  each  type  of  control  and 
type  of  change.   The  final  section  is  arranged  in  the 
following  order:  ClTl,  C1T2,  C1T3,  C1T4,  ClEl,  C1E2,  C1E3, 
C1E4,  C1P1,  C1P2,  C1P3,  and  C1P4. 
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C1T3S    (1) 

Guana  Co. —  Order  Verification  Procedure 

Preparation  of   raw  materials  purchase s  and  scheduling  to  Beet 
•ach  new  order  are  a  part  of  the  inventory  management    process  that  has 
been  automated.     Before  a  raw  aaterlals  purchase  order  is  generated, 
the  cuatoaer'a  credit-worthiness  and  the  order's  authenticity  are 
verified.      The  authenticity  of  orders  is  verified  because  of  the 
possibility  that  'fake*  orders  sight  be  placed.     A  salesaan  could 
collect  coaaisslons  on  the  "lake*  orders  before  be  quit,  and  the 
returned  orders  would  represent  a  substantial   loas. 

Both  of  these  controls  are  used  to  verify  the  authenticity  of  an 
order: 

1.  There  aust  be  a  duly  authorised  customer's  purchase  order.     In  the 
absence  of  a  customer  purchase  order,   a  "house"  purchase  order  Bay  be 
used. 

2.  The  customer   Is  asked  to  provide  a  letter  authorizing  shipment. 

Question  1.     Please  rate  the  strength  or  weakness  of  the  internal 
control   procedure  relating  to  order  verification. 
(Please  circle  your   response.) 


Very 

Very 

Weak 

art»cynat» 

Strong 

-4 

-3 

-2 

-1         1           +1 

+2 

+3 

44 

Question  2.     "Jot  referring  to  the  specific  procedure  described 

above,    how   important  to  the  overall  system  of  Internal 
controls  is  it  to  have  an  adequate  control  procedure 
for   order  verification?     (please   circle  your   response.) 

Hot  Very  Very 

Important  Taonrtanr 

I  +1  +2  +3  +4 

The  following  excerpt  from  the  external  auditor'a  management 
letter  was  passed  on  to  youi 

BTTBFJUL  AUDITOR'S  "UC0IHEBDATI0F4 

The  request  for  a  letter  authorising  shipment  is  unnecessary  and 
should  be  diacontinued. 

Hotel   The  external  auditor  views  this  change  as  relatively  acre 
critical   than  changes  recommended  In  prior  years. 

Question  3.     Assuming  the  change  la  implemented,   how  would  you 

evaluate  the  strength  of  the  order  verification  control 
procedure?     (Pleaae   circle  your   response.) 

Very  Very 

Weak  ad»otmte  fit-rono 

-4         -3         -2         -1       •         +1         +2         43         44 
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C1T3E    (2) 

Question  4.     Classify  the  recommended  change.      (Please  refer  to 
the  definitions  of  deElrable  and  undesirable  on  the 
cover   sheet,    and  circle  your   response.) 

a.  addition  of  a  desirable  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  s  desirable  control 

6,     deletion  of  an  undesirable  control 

••     a  alaultaneous  deletion  of  an  undesirable  control 

JuTD  the  addition  of  an  undesirable  control 
f.     a  alaultaneous  deletion  of  an  undesirable  control 

JuTO  the  addition  of  a  deairable  control 

Question  5.     In  order  for  ua  to  gauge  the  relative  laportance   of 

factors  that  will  Influence  your  decision  concerning  the 
recommended  change,    please  allocate  lis  points  to  the 
following  factorsi 

The  source  of  the  recoBBendatlon 

(the   asternal  auditor)  


The  tone  of  the  recommendation  

Tour  own  aaaesssent  of  the  economic  cost-benefit 

impact  on  your   company  from  the  change  

Other  factora    (pleaae  apecify  below)  

Total   (aust  add  to  111)  lie  points 

Other  factors: 

Question  6.     If  the  recommended  change  were  implemented,    in  your 
opinion  how  would  the  change  affect  the  quality  of  the 
overall  system  of  Internal  control?     (Please  circle  your 
response.) 

Greatly  Greatly 

Reduce                                  Internal  Improve 

Internal                              Control  Internal 

Control                                      nn.ffertxl  Contrn) 

-4         -3  -2       -1         f         +1  +2         +3           +4 

Duestlon  7.     What  would  you  communicate  to  the  audit  committee  about 
the   recommended   change?     (Pleaae  circle  your   response.) 

Strongly  Strongly 

Recommend  Recommend 

IfJtCtlM  acceptance 

-4    -3    -2   -1    I    +1   +2    43    +4 
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C1E4S    (1) 

Beta  Co.—  account*  Receivable  Data  Entry  Procedure 

Tour  company  has  developed  an  Accounts  Receivable  program.     The 
program  i*  designed  to  maintain  accounts  on  an  Invoice  by  Invoice 
basis   (rather   than  an  open  account  basis),    which  reduces  confusion 
about  discounts,   returns,  etc.     Accounts  receivable  are  entered  on- 
line in  batches,  containing  no  store  than  25  transactions,   from   lists 
which  have  been  prepared  In  another  department  where  the  checks  are 
recorded  and  deposited.     Entries  are  made  into  a  transaction  file, 
which  protects  the  main  data  file  until   the  batch  totals  are  proved, 
and  the  main  data  file  is  updated  with  the  transaction  file.     Errors 
Bade  in  entering  data  are  backed-out  and  entered  correctly  at  the  end 
of   each  batch.      The  list  that  goes  to  the  data  processing  transaction 
entry  department  includes  customer  account  number,  customer  name, 
invoice  number,    and  amount  of  payment.  The  list  is  accompanied  by  an 
adding  machine-prepared  batch  total  of  the  payments.  The  current 
system   requires  that  a  second  adding  machine  tape  be  prepared  from  the 
list  in  the  data  processing  transaction  entry  department  before  the 
entries  are  made.     The  batches  are  already  totalled  in  the  mail  room 
when  the  batches  and  deposits  are  prepared. 


EDF 

transaction 

xhxbx 

Batches 
entered. 

Batch  totals 

prepared 

from 

mail  room 

lists. 


EBP 

PunrBSSTKC 
Output  includes 
batch  totals 
which  are  compared 
with  totals  from 
■ail  room  and  EOF 
transaction  entry 
department. 


MAIL 
ROOM 

Payments 
received 
&  sorted  into 
batch cb. 

Lists  sre 
prepared. 
Batch  totals 
prepared  from 
lists. 

Question  1.  Please  rate  the  strength  or  weakness  of  the  internal 
control  procedure  relating  to  accounts  receivable  data 
entry.      (Please   circle  your    response.) 


Very 


-2 


IflsflttiU 
-1       t         +1 


+2 


♦3 


Very 
fltrano 
44 


Question  2.     Bot  referring  to  the  specific  procedure  described 
above,  how  important  to  the  overall  system  of  internal 
controls  Is  it  to  have  an  adequate  control  procedure 
for  accounts  receivable  data  entry?      (please  circle 
your  response.) 


Bot  Very 

Important 

f 


+1 


42 


Very 

tiaaxtint 

43  44 
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C1E4S    (2) 

The  following  excerpt  frea  the  external  auditor'*  aanageaent 
letter  »aa  passed  on  to  you: 

■XTER1AL  MIDITOR'S  UCOIWEKATIOII 

We  recoaaend  that  the  aecond  aanual  batch  total  be  abandoned,     t* 
alto  suggest  that  a  hath  total  of  account  nuabert  or  Invoices  be 
prepared  to  verify  that  the  correct  accounts  have  been  credited. 

■otei  The  external  auditor  vleve  this  change  at  relatively  »ar» 
critical  than  changes  recoaaended  in  prior  years. 

Question  3.     Assuaing  the  change  is  implemented,   how  would  you 
evaluate  the  strength  of  the  accounts  receivable  data 
entry  internal  control  procedure?      (Pleaae   circle  your 
response.) 

Very  Very 

Weak  Adequate  Eticr.c 

-4         -3         -2         -1       ■         +1         +2         +3         +4 

Question  4.     Classify  the  recoaaended  change.      (Please  refer  to 
the  definitions  of  desirable  and  undesirable  on  the 
cover   sheet,   and  circle  your   response.) 

a.  addition  of  a  desirable  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  a  desirable  control 

d.  deletion  of  an  undesirable  control 

e.  a  siaultaneous  deletion  of  an  undesirable  control 
AMD  the  addition  of  an  undesirable  control 

f.  a  siaultaneous  deletion  of  an  undesirable  control 
ABC  the  addition  of  a  desirable  control 

Queation  5.     In  order  for  ua  to  gauge  the  relative  importance   of 

factora  that  will  influence  your  decision  concerning  the 
recoaaended  change,    pleaae  allocate  III  points  to  the 
following  factorai 

The  aource  of  the  recoaaendation 

(the    external  auditor)  


The  tone  of  the  recoaaendation  

Tour  own  assessaent  of  the  economic  cost-benefit 

lapact  on  your  coapany  froa  the  change  

Other  factors    (pleaae  specify  below)  

Total  |auat  add  to  lie)  lie  points 

Other  factorai 
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C1E4S    (3) 

Queition  6.     If  the  recommended  change  were  implemented,   In  your 
opinion  how  would  the  change  affect  the  quality  of  the 
orarall  ayatem  of  Internal  control?     (Please  circle  your 
r  •■porta*.] 


Greatly 

Reduce 

Internal 

CcafctflJ 

-4  -3 


Internal 
Control 
Pn«ff»pt-.rt 
-1         I         +1 


Greatly 
Impr  ove 
Internal 

Control 
44 


Oueation  7.     What  would  you  communicate  to  the  audit  committee  about 
the   recommended   change?     (Pleaae  circle  your  response.) 


Strongly 

Recommend 
BeierMnn 
-4         -3 


-2   -1 


♦1 


Strongly 
Recommend 
acceptance 
+3     +4 
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ClPlv    (1) 

Alpha  Co. —  Program  and  Data  Integrity  Procedure 

The  program  development  group  has  full  access  to  the  computer  and 
data  files  to  facilitate  creation  and  testing  of  program  changes.     The 
program  development  group  usually  uses  old  accounts  receivable  and 
transactions  files  as  convenient  test  decks. 

Question  1.     Please  rate  the  strength  or  weakness  of  the  internal 

control  procedure  relating  to  program  and  data  integrity. 
(Please   circle  your   response.) 

Very  Very 

Mtii.  adeauate  fitrono 

-4         -3         -2         -1       I         +1         +2         +3         +4 

Question  2.     Wot  referring  to  the  specific  procedure  described 
above,  how  Important  to  the  overall  system  of  internal 
controls  Is  it  to  have  an  adequate  control  procedure 
for  program  and  data  Integrity?     (please  circle 
your  response.) 

Wot  Very  Very 

Important  Important 

(  +1  +2  +3  +4 

The  following  excerpt  from  the  external  audltor'a  management 
letter  was  passed  on  to  you: 

UTEKRAL  MDITOB'S  UCOHMEHDATIOH 

We  recommend  that  programmers  be  denied  operational  access  to 
both  the  computer  and  the  data  files. 

Wote:  The  external  auditor  views  this  change  aa  relatively  less 
critical  than  changes  recommended  In  prior  years. 

Question  3.     Assuming  the  change  is  implemented,   hov  would  you 

evaluate  the  strength  of  the  program  and  data  integrity 
Internal  control  procedure?      (Please  circle  your   response.) 

Very  Very 

Beak  Ademiat.  Btrnnn 

-4         -3         -2         -1       a         +i         +2         +3         +4 
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CIPlw   (2) 

Question  4.     Classify  the  recommended  change.      (Please  refer  to 
the  definitions  of  desirable  and  undesirable  on  the 
cover  sheet,   and  circle  your  response.) 

a.  addition  of  a  desirable  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  a  desirable  control 

d.  deletion  of  an  undesirable  control 

a.  a  simultaneous  deletion  of  an  undesirable  control 
US  the  addition  of  an  undesirable  control 

f.  a  simultaneous  deletion  of  an  undesirable  control 
MD  the  addition  of  a  desirable  control 

Question  5.     In  order  for  us  to  gauge  the  relative  importance   of 

factors  that  vill  Influence  your  decision  concerning  the 
recommended  change,    pleaae  allocate  lis  points  to  the 
following  factora: 

The  source  of  the  recommendation 

(the   asternal  auditor)  


The  tone   of   the  recommendation  

Tour  own  assessment  of  the  economic  cost-benefit 

impact  on  your  company  from  the  change  

Other  factora    (please  apecify  below)  

Total    (Bust  add  to  Its)  lie  points 

Other  factors: 

Question  6.     If  the  recommended  change  were  implemented,    in  your 
opinion  how  would  the  change  affect  the  quality  of  the 
overall  system  of  Internal  control?      (Please  circle  your 
response.) 

Greatly  Greatly 

Reduce                                  Internal  Improve 

Internal                              Control  Internal 

Control                                      nnaffected  Control 

-4         -3  -2       -1          •          +1  +2          +3            +4 

Question  7.     What  would  you  communicate  to  the  audit  committee  about 
the   recommended  change?     (Please  circle  your  response.) 

Strongly  Strongly 

Recommend  Recommend 

■.ejection  Acceptance 

-4         -3  -2       -1         ■         +1       +2         +3         +4 
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Very 

Weak 

Adeouate 

-4 

-3 

-2 

-1   1    +1 

ClP2w  (1) 

Delta  Co. —  Program  and  Data  Integrity  Procedure 

In  the  current   system  of  organization,    the  company  employe  a 
full-tine  software  librarian  who  works  within  the  data  processing 
deportment,.   Bowever,   the  librarian's  tine  la  only  partially  occupied 
with  EDP-llbrary  taeka. 

Queation  1.     Pleaae  rate  the  strength  or  weakneas  of  the  Internal 

control  procedure  relating  to  program  and  data  integrity. 
(Pleaae   circle   your    response.) 

Very 

fit rong 
+2    +3    +4 

Question  2.     Hot  referring  to  the  specific  procedure  described 

above,  how  Important  to  the  overall  system  of  Internal 
controls  is  it  to  have  an  adequate  control  procedure 
for   program  and  data  Integrity?      (pleaae  circle 
your  response.) 

Mot  Very  Very 

Important  Important 

e  +1  +2  +3  +4 

The  following  excerpt  from  the  external  auditor'a  management 
letter  was  passed  on  to  you: 

EXTERNAL   AUDITOR'S  MGOmERDATIOH 

He  recommend  that  the  software  librarian  be  trained  as  a 
computer  operator  in  addition  to  hiB  current  duties,  so  that  he  can 
diversify  his  tine  acroas  job  functions  aa  la  needed. 

Rote:  The  external  auditor  views  this  change  as  relatively  leee 
critical  than  changes  recommended  in  prior  years. 

Question  3.     Assuming  the  change  is  implemented,  how  would  you 

evaluate  the  strength  of  the  program  and  data  Integrity 
Internal  control  procedure?      (Please  circle  your  response.) 

Very 

-3         -2 


Very 

Adeuuate 

Strong 

•1   •    +1 

+2 

+3 

♦4 
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ClP2w    (2) 

Question  4.     Classify  the  recommended  change.      (Please  refer  to 
the  definitions  of  desirable  and  undesirable  on  the 
cover  sheet,    and  circle  your   response.) 

a.  addition  of  a  desirable  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  a  desirable  control 

d.  deletion  of  an  undesirable  control 

••  a  simultaneous  deletion  of  an  undesirable  control 
ME  the  addition  of  an  undesirable  control 

f.  a  simultaneous  deletion  of  an  undesirable  control 
JUTD  the  addition  of  a  dealrable  control 

Question  5.     In  order  for  us  to  gauge  the  relative  importance  of 

factors  that  vill   Influence  your  decision  concerning  the 
recommended  change,   please  allocate  KB  points  to  the 
following  factors: 


The  source  of  the  recommendation 
(the    external  auditor) 


The  tone  of  the  recommendation 


Tour  own  assessment  of  the  economic  cost-benefit 
impact  on  your   company  f torn  the  change 

Other  factors   (please  specify  below) 
Total   (Bust  add  to  111) 


IBe  points 


Other   factors:. 


Question  6.     If  the  recommended  change  were  implemented,   In  your 
opinion  how  would  the  change  affect  the  quality  of  the 
overall  system  of  Internal  control?      (Please  circle  your 
response.) 


Greatly 
Reduce 
Internal 
Control 
-4         -3 


Internal 
Control 
Unattested 
-l        f        +l 


+2 


+3 


Greatly 
Improve 
Internal 
Control 
♦4 


QueBtion  7.     What  would  you  communicate  to  the  audit  committee  about 
the   recommended  change?     (Please  circle  your  response.) 


Strongly 

Recommend 

Rejection 

-4  -3  -2 


+1        +2 


•trongly 
Recommend 

+3  +4 
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CaPlw  (1) 


M1Vb*-^'Z  Pro«r"1  •"«'  «»ta  Integrity  Procedure 

progratt,  development "roup usually  „«■ fS?K  °f  P"9""  «*»"9««.     The 
transactions  files  ."Sn^SSrt'tSl?  dSJ""""'"  "C"1»«M«  •»« 

Question  1       Please  rate  the  strength  or  weakness  of  the  internal 
Very 


Very 

fit™ 
♦1         +2         +3       ^4 


-3  -2  AdfiSUfttfi  Strong 

•»  -2  -1        t  +1  +2  +3         --.....,. 


Ouestion  2.     «ot  referring  to  the  specific  procedure  described 

8%  ik  IKK  *■«&«*  m& 

for  program  and  data  integrity?      (please  circle 
your   response.)  '*"-■■  clrcie 

»°t  Very  v 

*»?*«*    +1  +2  +3    Ivng* 

p..«o1,:n£?1o1°yWo1u=9  "eerPt  fr°"  the  *•*•"  .nalysfs  report  .as 

SISTERS  MULTST'S  MOOKHEHnMIOS 

both  t£  c«Cp;t"nd.ntdh"ttn,PrS^rfnieire6s.be  *"1,d  °»»'««««  «««  to 

Question  ^^J^ing  the  change  is  implemented,   how  would  you 

ESSE  £<£«&&«?  *%*£  'AgftASSL* 

Very 

Very 


^4         _3         .,  ,*MfUtt»  £LLSLa 

3      -2      -l    i      +i      +2      +3      ;;   v 
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Question  4.     Classify  the  recommended  change,      (please  refer  to 
the  definitions  of  desirable  and  undesirable  on  the 
cover   sheet*    and  circle  your  response.) 

a.  addition  of  a  desirable  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  a  desirable  control 

d.  deletion  of  an  undesirable  control 

*.  •  slBultaneous  deletion  of  an  undesirable  control 
ID  the  addition  of  an  undesirable  control 

t.  a  simultaneous  deletion  of  an  undesirable  control 
AND  the  addition  of  a  desirable  control 


Question  5.     In  order  for  us  to  gauge  the  relative  importance   of 

factors  that  will  influence  your  decision  concerning  the 
recommended  change,    please  allocate  100  points  to  the 
following  factorst 

The  source  of  the  recommendation 

(the   systems  analyst)  


The  tone  of  the  recommendation 


Tour  own  assessaent  of  the  economic  cost-benefit 
impact  on  your   company  from  the  change 

Other  factors    (please  specify  below) 
Total    (must  add  to  100) 


100  points 


Other  factors:. 


Question  C.     If  the  recommended  change  were  Implemented,    in  your 
opinion  how  would  the  change  affect  the  quality  of  the 
overall  system  of   internal   control?      (Please  circle  your 
response.) 


Greatly 
Reduce 
Internal 
Control 
-4         -3 


Internal 
Control 
Pnaffcctcd 
-2       -1  0  +1 


Greatly 

Improve 
Internal 
Control 
+3  +4 


Question  7.     What  would  you  communicate  to  the  audit  committee  about 
the  recommended  change?      (Please  circle  your  response.) 


Strongly 

Recommend 

Rejection 

-4  -3 


-2       -1 


Strongly 

Recommend 
acceptance 
+4 
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Very 

Adequate 

Kt  rona 

•1   1    +1 

42 

♦3 

+4 

CITlw    (1) 

■eta  Co. —     Order  Verification  Procedure 

Preparation  of  raw  materials  purchases  and  scheduling  to  sieet 
each  nev  order  are  a  part  of  the  Inventory  management  process  that  has 
been  automated.  Before  a  raw  materials  purchase  order  is  generated, 
the  customer's  credit-worthiness  and  the  order's  authenticity  are 
verified.  The  authenticity  of  orders  is  verified  becsuse  of  the 
possibility  that  "fake*  orders  might  be  placed.  A  salesman  could 
collect  commissions  on  the  "fake"  orders  before  be  quit,  and  the 
returned  orders  would  represent  a  substantial  loss.  Hie  control  used 
to  verify  the  authenticity  of  an  order  Is  the  presence  of  s  customer's 
duly  authorised  purchase  order.  Ho  special  provisions  hsve  been  msde 
for   phone   orders. 

Question  1.     Flesse  rste  the  strength  or  weskness  of  the  above 
Internal  control  procedure  relating  to  order 
verification.      (Please   circle  your    response.) 

Very 
Hut 
-4  -3  -2 

Question  2.     Rot  referring  to  the  specific  procedure  described 

above,  how  important  to  the  overall  system  of  internal 
controls  is  It  to  have  an  adequate  control  procedure 
for  order  verification?      (please   circle  your  response.) 

Hot  Very  Very 

Important  IlPBrtant 

9  +1  +2  +3  +4 

The  following  excerpt  from  the  external  auditor's  management 
letter  was  passed  on  to  youi 

EZTEMAL  AUDITOR'S  RECOHIIERDATXOR:      The  verification  of  phone  orders 
is  inadequate.     He  recommend  that  the  customer  be  ssked  to  provide  a 
letter  authorizing  shipment  or  a  duly  authorised  purchase  order  for 
phone  orders." 

Rotet     The  external  auditor  views  this  change  as  relatively  ltts 
critical  than  changes  recommended  in  prior  years. 

Question  3.     Assuming  the  change  is  implemented,   how  would  you 

evaluate  the  strength  of  the  order  verification  internal 
control   procedure?     (Please   circle  your  response.) 

Very  Very 

Weak  Mediate  «*'°"° 

-4         -3         -2         -1       f         +1         +2         *2         *i 
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Question  4.      Classify  the  recommended  change.      (Please  refer  to 

the  definitions  of  desirable  and  undesirable  on  the 
cover   sheet,   and  circle  your  response.) 

a.  addition  of  a  desirable  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  a  desirable  control 

d.  deletion  of  an  undesirable  control 

».  a  simultaneous  deletion  of  an  undeslrsble  control 
111)  the  addition  of  an  undeslrsble  control 

t .  a  simultaneous  deletion  of  an  undeslrsble  control 
ajtd  the  addition  of  a  desirable  control 

Question  5.     In  order  for  us  to  gauge  the  relative  laportance  of 

factors  that  will  Influence  your  decision  concerning  the 
recommended  change,    please  allocate  110  points  to  the 
following  factors: 

The  source  of  the  recommendation 

(the    external  auditor)  


Ihe  tone  of  the  recommendation  

Tour  own  assessment  of  the  economic  cost-benefit 

lapact  on  your  coapany  from  the  change  

Other  factors    (please  specify  below)  

Total    (aust  add  to  ls«)  lie  points 

Other  factors: 

Question  6.     If  the  recoaaended  change  were  implemented,    in  your 
opinion  how  would  the  change  affect  the  quality  of  the 
overall  system   of   Internal  control?      (Please  circle  your 
response.) 

Greatly  Greatly 

Reduce  Internal  Improve 

Internal  Control  Internal 

Control  nnaffected  Cent  ml 

-4  -3  -2       -1  •  +1  +2  +3  +4 

Question  7.     What  would  you  communicate  to  the  audit  coaalttee  about 
the   recoaaended  change?     {Please  circle  your  response.) 

Strongly  Strongly 

Recommend  Recommend 

Re -lection  lrc>nt»nr> 

-4    -3  -2   -1    S    +1   +2    +3    +4 
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Beta  Co. —  Order  Verification  Procedure 

Preparation  of  raw  materials  purchases  and  scheduling  to  meet 
•ach  new  order  are  a  part  of  the  Inventory  Management  process  that  has 
been  automated.     Before  a  raw  materials  purchase  order  is  generated, 
the  customer's  credit-worthiness  and  the  order's  authenticity  are 
verified.     The  authenticity  of  orders  is  verified  because  of  the 
possibility  that  *feke'  orders  might  be  placed.     A  salesmen  could 
collect  commissions  on  the  "fake*  orders  before  he  quit,  and  the 
returned  orders  would  represent  a  substantial  loss. 

Two  controls  are  used  to  verify  the  authenticity  of  an  order: 

1.  There  must  be  a  customer's  purchase  order  or  a   "house"  purchase 
order,    which  has  been  duly  authorised. 

2.  If  the  customer  fails  to  provide  a  purchase  order,  he  is  asked  to 
•end  a  letter  authorising  shipment. 

Question  1.     Plesse  rate  the  strength  or  weakness  of  the  Internal 
control  procedure  relating  to  order  verification. 
(Please   circle   your    response.) 

Very  V«y 

»»t  Adequate  Strong 

-4         -3  -2  -1        I  +1  +2  +3  +4 

Question  2.     Mot  referring  to  the  specific  procedure  described 

above,    how   important  to  the  overall  system  of  internal 
controls  is  it  to  have  an  adequate  control  procedure 
for   order  verification?     (please   circle  your    response.) 

Hot  Very  Very 

r.pnrtant  Important 

•  +1  +2  +3  +4 

The  following  excerpt  from  the  external  auditor's  management 
letter  was  passed  on  to  you: 

BXTERKAL  AUDITOR'S  RECOAMHDATIOK 

The  letter  authorising  shipment  la  unnecessary.     It  should  not  be 

required. 

note:  The  external  auditor  views  this  change  as  relatively  leu 
critical  than  changes  recommended  In  prior  year*. 

Question  3.     Assuming  the  change  is  implemented,  bow  would  you 

evaluate  the  strength  of  the  order  verification  internal 
control   procedure?     (Please   circle  your  response.) 

Very  V«y 

weak  Adequate  fitlflnfl 

-4  -3  -2  -1        I  +1  +2  +3  +4 


155 


ClT2v  (2) 

Question  4.      Classify  the  recommended  change.      (Please  refer  to 
the  definitions  of  desirable  and  undesirable  on  the 
cover   sheet,    and  circle  your   response.) 

a.  addition  of  a  desirable  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  a  desirable  control 

d.  deletion  of  an  undesirable  control 

e.  a  simultaneous  deletion  of  an  undesirable  control 
AHD  the  addition  of  an  undesirable  control 

f.  a  simultaneous  deletion  of  an  undesirable  control 
MID  the  addition  of  a  desirable  control 

Question  5.     In  order  for  us  to  gauge  the  relative  importance  of 

factors  that  will  Influence  your  decision  concerning  the 
recommended  change,    please  allocate  111  points  to  the 
following  factors: 

The  source  of  the  recommendation 

(the   external  auditor)  


The  tone  of  the  recommendation  

Tour  own  aasessment  of  the  economic  cost-benefit 

impact  on  your  company  from  the  change  __^_ 

Other  factors    (please  specify  below)  __^_ 

Total    (must  add  to  111)  111  points 

Other  factors: 

Question  6.     If  the  recommended  change  were  implemented,   in  your 
opinion  how  would  the  change  affect  the  quality  of  the 
overall  system  of   Internal  control?     (Please  circle  your 
response.) 

Greatly  Greatly 

Reduce                                  Internal  Improve 

Internal                            Control  Internal 

Control                                     nnaff»ct.rt  Control 

-4         -3  -2       -1         •         +1  +2         +3           +4 

Question  7.     What  would  you  communicate  to  the  audit  committee  about 
the  recommended  change?     (Please  circle  your  response.) 

Strongly  Strongly 

Recommend  Recommend 

Bt  ICCtlOn  Acceptance 

-4  -3  -2       -1  •  +1        +2  +3  +4 
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Beta  Co. —  Order  Verification  Procedure 

Preparation  of   raw  materials  purchases  and  scheduling  to  meet 
•ach  new  order  are  a  part  of  the  inventory  management  process  that  has 
been  automated.     Before  a  raw  aaterials  purchase  order  is  generated, 
the  customer's   credit-worthiness  and  the  order's  authenticity  are 
verified.     The  authenticity  of  orders  is  verified  because  of  the 
possibility  that  fake*  orders  Bight  be  placed.     A  salesaan  could 
collect  commissions  on  the  'fake'  ordera  before  he  quit,   and  the 
returned  orders  would  represent  a  substantial  loss. 

Both  of  these  controls  are  need  to  verify  the  authenticity  of  an 
orden 

1.  There  aust  be  a  duly  authorised  customer'!  purchase  order.      In  the 
absence  of  a  custoaer  purchase  order,   a  "house*  purchase  order  may  be 
uaec. 

2.  The  custoaer  is  asked  to  provide  a  letter  authorising  shipment. 

Question  1.     Pleaae  rate  the  strength  or  weakness  of  the  Internal 
control  procedure  relating  to  order  verification. 
(Pleaae  circle  your   response.) 


Very 

Very 

KcAfc 

Adequate 

Strong 

-4 

-3 

-2 

-1    t     +1 

♦2 

+3 

♦4 

Question  2.     lot  referring  to  the  specific  procedure  described 

above,    how   important  to  the  overall  system  of  Internal 
controls  is  it  to  hsve  an  adequate  control  procedure 
for   order  verification?     (please   circle  your    response.) 

Bot  Very  Very 

Important  Important 

I  +1  +2  +3  +4 

The  following  excerpt  from  the  external  auditor's  aanageaent 
letter  was  passed  on  to  yout 

KXTERHAL  AUDITOR' 8  BBCOHKERDATIOI) 

The  request  for  a  letter  authorising  shipment  is  unnecessary  and 
should   be   discontinued. 

Bote:  The  external  auditor  views  this  change  as  relatively  IBM 
critical   than  changes  recommended  in  prior  yeara. 

Question  3.     Assuming  the  change  Is  Implemented,    how  would  you 

evaluate  the  strength  of  the  order  verification  control 
procedure?     (Please   circle  your  response.) 

Very  Very 

JutaJl  adgqimte  Strong 

-4         -3         -2         -1       t         +1         +2         43         +4 


157 


ClT3w    (2) 

Question  4.     Classify  the  recommended  change.      (Please  refer  to 
the  definitions  of  desirable  and  undesirable  on  the 
cover   sheet,    and  circle  your  response.) 

a.  addition  of  a  desirable  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  a  desirable  control 

d.  deletion  of  an  undesirable  control 

e.  a  simultaneous  deletion  of  an  undesirable  control 
m  the  addition  of  an  undesirable  control 

f.  a  simultaneous  deletion  of  an  undesirable  control 
MS  the  addition  of  a  desirable  control 

Question  5.     In  order  for  us  to  gauge  the  relative  importance  of 

factors  that  will  Influence  your  decision  concerning  the 
recommended  change,   please  allocate  lit  points  to  the 
following  factors: 

The  source  of  the  recommendation 

(the   external  auditor)  


The  tone  of  the  recommendation  

Tour  own  assessment  of  the  economic  cost-benefit 

Impact  on  your  company  from  the  change  

Other  factors    (plesse  specify  belov)  ___^ 

Total    (must  add  to  11B)  lie  points 

Other  factors: 

Question  C.     If  the  recommended  change  were  implemented,    In  your 
opinion  hov  would  the  change  affect  the  quality  of  the 
overall  system  of   Internal  control?     (Please  circle  your 
response.) 

Greatly  Greatly 

Reduce                                  Internal  Improve 

Internal                              Control  Internal 

Control                                      Dnaffecf  fl  Central 

-4         -3  -2       -1         *         +1  +2         +3           +4 

Question  7.     What  would  you  communicate  to  the  audit  committee  about 
the  recommended  change?     (Please  circle  your  response.) 

Strongly  Strongly 

Recommend  Recommend 

«fiECtipn  acceptance 

-4  -3  -2       -1  f  +1        +2  +3  +4 
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C1T4V   (1) 

Alpha  Co. —  Order  Verification  Procedure 

Preparation  of  taw  aaterlals  purchase*-  and  scheduling  tc  Beet 
each  new  order  are  a  part  of  the  Inventory  management  process  that  has 
been  automated.     Before  a  raw  aaterlals  purchase  order  Is  generated, 
the  custoaer's  credit-worthiness  and  the   order's  authenticity  are 
verified.      The  authenticity  of  orders  is  verified  because  of  the 
possibility  that  fake*  orders  Bight  be  placed.     A  salenan  could 
collect  coaalssions  on  the  "fake*  orders  before  be  quit,   and  the 
returned  orders  would  represent  a  substantial   loss. 

Two  controls  are  used  to  verify  the  authenticity  of  an  orderi 
(1)  the  presence  of  a  custOBer's  purchase  order,  jjuJ  (2)  the  presence 
of  a  custoaer's  letter  authorising  shipment. 

Question  1.     Please  rate  the  strength  or  weskness  of  the  Internal 

control  procedure  relating  to  order  verification.      (Please 
circle  your   response.) 


Very 

Very 

Meat 

aaaanata 

fitrono 

-4 

-3 

-2 

-1   (    +1 

+2 

+3 

♦4 

Question  2.     lot  referring  to  the  specific  procedure  described 

above,   bow   important  to  the  overall  system  of  internal 
controls  Is  it  to  have  an  adequate  control  procedure 
for   order  verification?     (pleaae   circle  your   response.) 

Hot  Very  Very 

Important  Important 

I  41  +2  +3  +4 

The  following  excerpt  from  the  external  auditor's  management 
letter  was  passed  on  to  yout 

■XTEPJUM,  AUDITOR'S  RECOMMENDATION 

In  the  event  that  a  customer's  purchase  order  accompanies  the 
order.   It  is  not  necessary  to  request  a  letter  of  authorisation  for 
the  purchase.  However,   a  list  of  the  customer's  personnel   who  Bay 
authorise  a  purchase  should  be  maintained  so  that  the  authorising 
signature  may  be  compared  with  it. 

Mote:  The  external  auditor  views  this  change  as  relatively  leas 
critical  than  changes  recommended  in  prior  years. 

Question  3.     Assuming  the  change  Is  implemented,   bow  would  you 

evaluate  the  strength  of  the  order  verification  Internal 
control   procedure?     (Please   circle  your  response.) 

Very 
fitrono 
+2         +3         *4 


Very 

Meat 

Adeouate 

-4 

-3 

-2 

-1    •    +1 
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Queitlon  4.      Classify  the  recommended  change.      (Please  refer   to 
the  definitions  of  desirable  and  undesirable  on  the 
cover   sheet,    and  circle  your   response.) 

a.  addition  of  a  desirable  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  a  desirable  control 

d.  deletion  of  an  undesirable  control 

».  a  simultaneous  deletion  of  an  undesirable  control 
MD  the  addition  of  an  undesirable  control 

f.  a  sisvultaneous  deletion  of  an  undesirable  control 
mid  the  addition  of  a  desirable  control 

Question  5.     In  order  for  us  to  gauge  the  relative  importance   of 

factors  that  vlll  Influence  your  decision  concerning  the 
recommended  change,    please  allocate  KB  points  to  the 
following  factors! 


The  source  of  the  recommendation 
(the    external  auditor) 

The  tone  of  the  recommendation 

Tour  own  assessment  of  the  economic  cost-benefit 
impact  on  your   company  from  the  change 

Other  factors    (please  specify  below) 
Total    (Bust  add  to  lee) 


lee  points 


Other  factors: 


Question  6.      If  the  recommended  change  were  implemented,    in  your 
opinion  how  would  the  change  affect  the  quality  of  the 
overall  system  of   internal  control?      (Please  circle  your 
response.) 


Greatly 
Reduce 
Internal 
Control 
-4         -3 


Internal 
Control 

Pn»fferf»d 
-1  •  +1 


Greatly 
Improve 
Internal 
Control 
♦4 


Question  7.     What  would  you  communicate  to  the  audit  committee  about 
the  recommended  change?     (Please  circle  your  response.) 


Strongly 
Recommend 
Reaction 
-4  -3 


-2       -1 


+1 


Strongly 
Recommend 

Acceptance 

+3    +4 
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Delta  Co. —  Account*  Receivable  lata  Entry  Procedure 

Your  company  has  developed  an  Accounts  Receivable  program.     The 
program  la  designed  to  maintain  accounts  on  an  Invoice  by  Invoice 
basis  (rather  than  an  open  account  basis),    which  reduces  confusion 
about  discounts,   returns,   ate.     Accounts  receivable  are  entered  on- 
line In  batches,  containing  no  Bore  than  25  transactions,  from  lists 
which  have  been  prepared  in  another  department  vhere  the  checks  are 
recorded  and  deposited.     Entries  are  Bade  into  a  transaction  file, 
which  protects  the  main  data  file  until   the  batch  totals  are  proved, 
and  the  Bain  data  file  la  updated  with  the  transaction  file.     Errors 
Bade  in  entering  data  are  backed-out  and  entered  correctly  at  the  end 
of  each  batch.      Batch  totals  are  not  applied  to  the  corrected  batch 
before  updating  the  aain  data  file. 

Question  1.     Please  rate  the  strength  or  weakness  of  the  internal 
control  procedure  relating  to  accounts  receivable  date 
entry.      Pleaee  circle  a  response. 

Very  Very 

Weak  Adeaiiat-e  Strong 

-4         -3         -2         -1       ■         +1         +2         +3         +4 

Question  2.     Mot  referring  to  the  specific  procedure  described 
above,  how  important  to  the  overall  system  of  Internal 
controls  is  it  to  have  an  adequate  control  procedure 
for  accounts  receivable  data  entry?      (please  circle 
your  response.) 

Hot  Very  Very 

Important  lupprtant 

I  +1  +2  43  +4 

The  following  excerpt  from  the  external  auditor's  management 
letter  was  paaaed  on  to  you: 

EXTERHAL  AUDITOR'S  RBCOMEUDATIOH 

He  recommend  that  corrected  batches  be  submitted  to  the  same 
teats  as  uncorrected  batches  in  caae  any  errors  were  not  properly 
corrected. 

Bote:  The  external  auditor  views  this  change  as  relatively  lees 
critical  than  changes  recommended  in  prior  years. 

Question  3.     Assuming  the  change  la  Implemented,   how  would  you 
evaluate  the  strength  of  the  accounts  receivable  data 
entry  Internal   control  procedure?     (Please  circle  your 
response.) 

Very  Very 

JJejLk.  Adequate  Strong 

-4  -3  -2  -1        I  +1  +2  +3  +4 


161 


ClElw   (2) 

Question  4.     Classify  the  recommended  change.      (Please   refer  to 
the  definitions  of  desirable  and  undesirable  on  the 
cover   sheet,    and  circle  your   response.) 

a.  addition  of  a  desirable  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  a  desirable  control 

d.  deletion  of  an  undesirable  control 

c.  a  altiultaneous  deletion  of  an  undesirable  control 
_U>  the  addition  of  an  undesirable  control 

f.  a  simultaneous  deletion  of  an  undesirable  control 
jutd  the  addition  of  a  desirable  control 

Question  5.     In  order  for  us  to  gauge  the  relative  importance  of 

factors  that  will   Influence  your  decision  concerning  the 
recommended  change,   please  allocate  let  points  to  the 
following  factorst 

The  source  of  the  recommendation 

(the   asternal  auditor)  


The  tone  of  the  recommendation  

Tour  own  assessment  of  the  economic  cost-benefit 

Impact  on  your  company  from  the  change  _____ 

Other  factors   (please  specify  below)  

Total   (must  add  to  lie)  lee  points 

Other   factors: 

Question  6.     If  the  recommended  change  were  implemented,   In  your 
opinion  how  would  the  change  affect  the  quality  of  the 
overall  system  of  Internal  control?      (Flease  circle  your 
response.) 

Greatly  Greatly 

Reduce  Internal  Improve 

Internal  Control  Internal 

Control  nnafferted  _— __ 

-4         -3         -2       -1         I         +1       +2         +3  +4 

Question  7.     What  would  you  communicate  to  the  audit  committee  about 
the  recommended  change?     (Flease  circle  your  response.) 

Strongly  Strongly 

Recommend  Recommend 

Reaction  acceptance 

-4  -3  -2        -1  •  +1        +2  +3  *4 
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Alpha  Co. —  Account*  Receivable  Data  Entry  Procedure 

Tour  coapany  has  developed  an  Accounts  Receivable  program.     The 
program  Is  designed  to  Maintain  accounts  on  an  Invoice  by  Invoice 
basis   (rather  than  an  open  account  basis),   which  reduces  confusion 
about  discounts,   returns,  etc.     Accounts  receivable  are  entered  on- 
line In  batches,  containing  no  sore  than  25  transactions,  from  lists 
which  hsve  been  prepared  in  another  department  where  the  checks  are 
recorded  and  depoaited.      Entries  are  Bade  into  a  transaction  file, 
which  protects  the  main  data  file  until  the  batch  totals  are  proved, 
and  the  sain  data  file  la  updated  with  the  transaction  file.     Errors 
Bade  In  entering  data  are  backed-out  and  entered  correctly  at  the  end 
of  each  batch.     The  list  that  goes  to  the  data  processing  transaction 
entry  department  Includes  custoaer  account  number,  customer  name. 
Invoice  number,  and  amount  of  payment.     If  a  check  covers  several 
invoices,    each  invoice  is  listed  as  a  separate  transaction. 

The  coapany  uses  two  batch  totala:  the  sua  of  the  amounts  to  be 
credited  to  the  accounts  in  each  batch,  and  the  a urn  of  the  account 
numbers  Involved.  The  second  total   is  s  verification  that  the  account 
numbers  were  correctly  entered  into  the  system. 

Question  1.     Please  rate  the  strength  or  weakness  of  the  internal 
control  procedure  relating  to  accounts  receivable  data 
entry.      (Please   circle  your    response.) 


Very 

Very 

weak 

Adeguate 

£trona 

-4 

-3 

-2 

-1   •   +1 

+2 

+3 

♦4 

Question  2.     Hot  referring  to  the  specific  procedure  described 

above,  how  Important  to  the  overall  system  of  internal 
controls  Is  it  to  have  an  adequate  control  procedure 
for  accounts  receivable  data  entry?      (pleaae  circle 
your  response.) 

Hot  Very  Very 

Important  Important 

•  +1  *2  +3  +4 

The  following  excerpt  from  the  external  auditor's  management 
letter  was  passed  on  to  you: 

ETTEWJAL  AUDITOR' E  RSCOHKEBDATIOK 

We  feel  that  the  second  batch  total  Is  unnecessary. 

Rotei  The  external  auditor  views  this  change  as  relatively  aeie. 
critical  than  changes  recommended  in  prior  years. 

Question  3.     Aseumlng  the  change  is  implemented,  how  would  you 
evaluate  the  strength  of  the  accounts  receivable  data 
entry  Internal  control  procedure?     (Pleaae  circle  your 
response.) 

Very 
UA 
-4         -3  -2 


Very 

Adtguatc 

strong 

■l   1   +1 

42 

+3 

♦4 
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Question  4.     Classify  the  recommended  change.      (Please  refer   to 
the  definitions  of  desirable  and  undesirable  on  the 
cover   sheet,    and  circle  your   response.) 

a.  addition  of  a  desirable  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  a  desirable  control 

d.  deletion  of  an  undesirable  control 

a.  a  ainultaneous  deletion  of  an  undesirable  control 
WD  the  addition  of  an  undesirable  control 

f.  a  ainultaneous  deletion  of  an  undesirable  control 
id  the  addition  of  a  desirable  control 

Question  5.      In  order  for  us  to  gauge  the  relative  Importance  of 

factors  that  vill   influence  your  decision  concerning  the 
recommended  change,   please  allocate  100  points  to  the 
following  factors: 

The  source  of  the  recommendation 

(the   external  auditor)  


The  tone  of  the  recommendation  

Tour  own  assessment  of  the  economic  cost-benefit 

Impact  on  your  company  from  the  change  

Other  factors   (please  apecify  below)  

Total   (aust  add  to  100)  100  points 


Other   factors:. 


Question  6.     If  the  recommended  change  were  implemented,   in  your 
opinion  how  would  the  change  affect  the  quality  of  the 
overall  system  of  internal  control?      (Please  circle  your 
response.) 


Greatly 
Reduce 
Internal 
control 
-4  -3 


-2 


Internal 

Control 

nn.ff.cted 

-1       f      +1 


+2 


Greatly 
Improve 
Internal 
Control 
+3  +4 


Question  7.     What  would  you  communicate  to  the  audit  committee  about 
the  recommended  change?     (Pleaae  circle  your  response.) 


Strongly 

Recommend 
Ktjtctlcn 

-4    -3 


+1   +2 


Strongly 

Recommend 

♦3     +4 
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Alpha   Co. —  Account!  Receivable  Data  Entry  Procedure 

Tour  company  has  developed  an  Accounts  Receivable  program.     The 

Kogram  is  designed  to  aalntaln  accounts  on  an  Invoice  by  Invoice 
■is   (rather   than  an  open  account  basis),    which  reduces  confusion 
•bout  discounts,   returns,  etc.     Accounts  receivable  are  entered  on- 
line in  batches,  containing  no  more  than  25  transactions,   from  lists 
which  have  been  prepared  in  another  department  where  the  checks  are 
recorded  and  deposited.     Entries  are  Bade  into  a  transaction  file, 
which  protects  the  sain  data  file  until  the  batch  totals  are  proved, 
and  the  aain  data  file  is  updated  with  the  transaction  file.     Errors 
Bade  in  entering  data  are  backed-out  and  entered  correctly  at  the  and 
of  each  batch.      The  list  that  goes  to  the  data  processing  transaction 
entry  department  includes  customer  account  nuaber,  custoaer  nane, 
invoice  nuaber,    and  amount  of  payment.     The  system  requires  that  a 
second  adding  machine  tape  be  prepared  from  the  list  in  the  data 
processing  transaction  entry  department  before  the  entries  are  made. 
The  batches  are  already  totalled  in  the  Ball  room  when  the  batches  and 
deposits  are  prepared. 


HAIL 
ROOK 

Payments 

received 

t  sorted  into 

batches. 

Lists  sre 
prepared. 

Batch  totals 
prepared  from 
lists. 


EDP 
TRANSACTION 

ENTRY 

Batches 
entered. 

Batch  totals 
prepared 
from  lists. 


EDP 

noaaaiafi 

Output  includes 
batch  totals 
which  are  compared 
with  totals  from 
Ball   room  and  EDP 
transaction  entry 
department. 


Question  1.     Please  rate  the  strength  or  weakness  of  the  Internal 
control  procedure  relating  to  accounts  receivable  data 
entry.      (Pleaae   circle  your   response.) 


Very 


-3 


liaaai&s 

-i     i       +i 


+3 


Very 
Strong 
+4 


Question  2.     »ot   referring  to  the  specific  procedure  described 
above,  how  important  to  the  overall  system  of  internal 
controls  is  it  to  have  an  adequate  control  procedure 
for  accounts  receivable  data  entry?      (please  circle 
your  response.) 


Not  Very 
Important 

•  +1 


+2 


Very 
Important 
+3  *4 
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The  following  excerpt   from  the  external  auditor's  asnsgement 
letter  was  passed  on  to  youi 

BTER-AL  AUDITOR'S  1KDKKEKDATION 

The  electronic  totalling  procedure  is  very  accurate.     We 
recoaaend  discontinuing  the  second  aanual  batch  total   (prepared  in  the 
EDP  transaction  entry  dept.). 

■ote:     The  external  auditor  views  this  change  aa  relatively  »nr* 
critical  than  changes  recestnended  in  prior  yesrs. 

Question  3.     Assuming  the  change  is  lapleaented,   how  would  you 
evaluate  the  strength  of  the  accounts  receivable  data 
entry   internal  control  procedure?     (Please  circle  your 
response.) 


Very 

■eak 

-3 

-2 

+2 

+3 

Very 

fit rono 

-4 

-1   •    +1 

+4 

Question  4.     Classify  the  reconnended  change.      (Please  refer  to 
the  definitions  of  desirable  and  undesirable  on  the 
cover   sheet,    and  circle  your   reaponse.) 

a.  addition  of  a  desirable  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  a  desirsble  control 

d.  deletion  of  an  undesirable  control 

•  .  a  siaultaneouB  deletion  of  an  undesirable  control 
MID  the  addition  of  an  undesirable  control 

f.  a  simultaneous  deletion  of  an  undesirable  control 
aHD  the  addition  of  a  desirable  control 

Question  5.     In  order  for  us  to  gauge  the  relative  Importance   of 

factors  that  will  influence  your  decision  concerning  the 
reconnended  change,    please  allocate  HI  points  to  the 
following  factorai 

The  source  of  the  recommendation 

(the   external  auditor)  _____ 

The  tone  of  the  recommendation  

Tour  own  assessment  of  the  economic  coat-benefit 

lapact  on  your   company  from  the  change  

Other  factora    (please  apecify  below)  

Total   (aust  add  to  ltl)  1M  points 

Other  factors>_ 
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Question  6.     If  the  recommended  change  were  implemented,   in  your 
opinion  hov  would  the  change  affect  the  quality  of  the 
overall  system  of  internal  control?     (Fleaae  circle  your 
response.) 

Greatly  Greatly 

Reduce  Internal  Improve 

Internal  Control  Internal 

control  amtftctid  Control 

-4         -3         -2       -1         I         +1       +2         +3  +4 

Queatlon  7.     What  would  you  communicate  to  the  audit  committee  about 
the   recommended   change?     (Fleaae  circle  your  response.) 

Strongly  Etrongly 

Recommend  Recommend 

Re  Sect  Inn  Acceptance 

-4         -3  -2       -1  (  +1        +2  +3  +4 
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Delta  Co. —  Accounts  leceivable  Data  Entry  Procedure 

Tour  company   has  developed  en  Accounts  Receivable  program.     The 
program  is  designed  to  aalntaln  accounts  on  an  invoice  by  invoice 
basis   (rather  than  an  open  account  basis),   which  reduces  confusion 
about  discounts,   returns,  etc.     Accounts  receivable  are  entered  on- 
line In  batches,  containing  no  aore  than  25  tranaactions,  from  lists 
which  have  been  prepared  in  another  department  where  the  checks  are 
recorded  and  deposited.      Entries  are  aade  into  a  transaction  file, 
which  protects  the  main  data  file  until  the  batch  totals  are  proved, 
and  the  aaln  data  file  Is  updated  with  the  transaction  file.     Errors 
■ade  in  entering  data  are  backed-out  and  entered  correctly  at  the  end 
of  each  batch.     The  list  that  goes  to  the  data  processing  transaction 
entry  deportment  Includes  customer  account  number,  customer  name. 
Invoice  number,    and  amount  of  payment.  The  list  is  sccompanied  by  an 
adding  machine-prepared  batch  total  of  the  payments.  The  current 
system   requires  that  a  aecond  adding  machine  tape  be  prepared  from  the 
list  in  the  data  processing  transaction  entry  department  before  the 
entries  are  aade.     The  batches  are  already  totalled  in  the  mail  room 
when  the  batches  and  deposits  are  prepared. 


HAIL 

BOOM 

Payments 

received 

(  sorted  into 

batches. 

Lists  sre 
prepared. 
Batch  totals 
prepared  from 
lists. 


ECP 
TRANSACTION 


Batches 
entered. 

Batch  totals 

prepared 

from 

aail  room 

lists. 


■DP 

PBfirEBSTMC; 

Output  includes 
batch  totals 
which  are  compared 
with  totals  from 
aail  room  and  EDP 
transaction  entry 
department. 


Question  1.     Plesse  rate  the  strength  or  weakness  of  the  internal 
control  procedure  relating  to  accounts  receivable  data 
entry.      (Please   circle  your   response.) 


Very 

Weak 

-4 


-2 


Meguatt 
-1       I         +1 


+3 


Very 
Strong 
+4 


Question  2.     Sot  referring  to  the  specific  procedure  described 
above,  now  Important  to  the  overall  system  of  internal 
controls  is  it  to  have  an  adequate  control  procedure 
for  accounts  receivable  data  entry?      (please  circle 
your  response.) 


Hot  Very 

Important 

•  +1 


Very 

Important 
+3  +4 
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The  following  excerpt  froa  the  external  auditor'*  aanageaent 
letter  was  passed  on  to  you: 

DTERIM  AUDITOR'S  MCOKHZHDATION 

He  recoaaend  that  the  second  aanual  batch  total  be  abandoned.     M 
also  suggest  that  a  hash  total  of  account  numbers  or  invoices  be 
prepared  to  verify  that  the  correct  accounts  have  been  credited. 

Hotel  The  external  auditor  views  this  change  as  relatively  Ieejs 
critical  than  changes  recoaaended  in  prior  years. 

Question  3.     Assuming  the  change  is  iapleaented,  how  would  you 
evaluate  the  strength  of  the  accounts  receivable  data 
entry  internal  control  procedure?     (Please  circle  your 
response.) 


Very 

Very 

Keek 

Adeouate 

fitrona 

-4 

-3 

-2 

-1   0    +1 

+2 

♦3 

+4 

Question  4.      Classify  the  recoaaended  change.      (Please  refer  to 
the  definitions  of  desirable  and  undesirable  on  the 
cover   sheet,    and  circle  your  response.) 

a.  addition  of  a  desirable  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  a  desirable  control 

d.  deletion  of  an  undesirable  control 

e.  a  simultaneous  deletion  of  sn  undesirable  control 
AND  the  addition  of  an  undesirable  control 

f.  a  slaultaneous  deletion  of  an  undesirable  control 
AND  the  addition  of  a  desirable  control 

Question  5.     In  order  for  us  to  gauge  the  relative  importance   of 

factors  that  will  influence  your  decision  concerning  the 
recoaaended  change,    please  allocate  100  points  to  the 
following  fsctorsi 

The  source  of  the  recommendation 

(the    external  auditor)  

The  tone  of  the  racoaaendation  


Tour  own  assessaent  of  the  econoalc  cost-benefit 

lapact  on  your  company  from  the  change  

Other  factors    (please   specify  below)  

Total    (aust  add  to  100)  100  points 

Other  factor*! 
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Question  6.     If  the  recommended  change  were  implemented,   in  your 
opinion  how  would  the  change  affect  the  quality  of  the 
overall   system  of  Internal  control?      (Please  circle  your 
response.) 

Greatly 
IB  prove 
Internal 
Control 
+2  43  +4 

Question  7.     What  would  you  communicate  to  the  audit  committee  about 
the   recommended  change?     (Please  circle  your  response.) 

Strongly  Strongly 

Recommend  Recommend 

Be -lection  acceptance 

-4    -3  -2   -1     •     +1    +2    +3     +4 


Greatly 

Reduce 

Internal 

Internal 

Control 

Control 

Pniffected 

-4    -3 

-2 

-l   ■   +i 
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Co. —  Program  and  Data    Integrity   Procedure 
The  program   development  group  has  full  access  to  the  computer  and 
data  files  to  facilitate  creation  and  testing  of  program  changes.     The 
program  development  group  usually  uses  old  accounts  receivable  and 
transactions  files  as  convenient  test  decks. 

Question  1.     Please  rate  the  strength  or  weakness  of  the  internal 

control  procedure  relating  to  program  and  data  integrity. 
(Pleaae   circle  your   response.) 


Very 

Weak 

Adeauat* 

Very 

fitrGnc 

-4 

-3 

-2 

-1        •           +1 

♦2 

+3 

+4 

Question  2.     Mot  referring  to  the  specific  procedure  described 
above,  bow  Important  to  the  overall  system  of  internal 
controls  is  it  to  have  an  adequate  control  procedure 
for  program  and  data  Integrity?     (please  circle 
your  response.) 

Hot  Very  Very 

Important  Important 

•  41  42  43  44 

The  following  excerpt  from  the  external   auditor'a  management 
letter  was  passed  on  to  you: 

EXTERNAL   AUDITOR' £  RECOMMENDATION 

We  recommend  that  programmers  be  denied  operational  access  to 
both  the  computer  and  the   data  files. 

Motet  The  external  auditor  views  this  change  as  relatively  more 
critical   than  changes  recommended  in  prior  years. 

Question  3.     Assuming  the  change  is  implemented,   how  would  you 

evaluate  the  strength  of  the  program  and  data  Integrity 
Internal  control  procedure?      (Please  circle  your   response.) 

Very  Very 

leak  MtBMtl  Strong 

-4  -3  -2  -1        «  41  42  43  44 
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Question  4.      Classify  the  recommended  change.      (Please  refer  to 
the  definitions  of  desirable  and  undesirable  on  the 
cover  sheet,   and  circle  your  response.) 

a.  addition  of  a  desirable  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  a  desirable  control 

d.  deletion  of  an  undesirable  control 

a.  a  simultaneous  deletion  of  an  undesirable  control 
MD  the  addition  of  an  undesirable  control 

f.  a  simultaneous  deletion  of  an  undesirable  control 
MD  the  addition  of  a  deairable  control 

Question  5.     In  order  for  us  to  gauge  the  relative  Importance   of 

factors  that  will  influence  your  decision  concerning  the 
recommended  change,   please  allocate  KB  pointB  to  the 
following  factors: 

The  source  of  the  recommendation 

(the   asternal  auditor)  


The  tone  of  the  recommendation  

Tour  own  assessment  of  the  economic  cost-benefit 

Impact  on  your  company  from  the  change  

Other  factors    (please  specify  below)  

Total    (Bust  add  to  KB)  lM  points 

Other  factors: „ 

Question  6.     If  the  recommended  change  were  implemented,    in  your 
opinion  how  would  the  change  affect  the  quality  of  the 
overall  system  of  internal  control?     (please  circle  your 
response . ) 

Greatly  Greatly 

Deduce                                  Internal  Improve 

Internal                            Control  Internal 

con*"!                          Unaffected.  Centre] 

-4         -3  -2       -1         ■         +1  +2         +3           +4 

Question  7.     What  would  you  communicate  to  the  audit  committee  about 
the  recommended  change?     (Pleaae  circle  your   response.) 

Strongly  Strongly 

Recommend  Recommend 

s.-urtion  Acceptance 

-4    -3    -2   -1    •    +1   +2    +3    +4 
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Delta  Co. —  Program  and  Data  Integrity  Procedure 

In  the  current  system  of  organization,   the  company  employs  a 
full-tine  software  librarian  who  works  within  the  data  processing 
department,.   However,    the  librarian's  tine  la  only  partially  occupied 
with  EDP-llbrary  tasks. 

Question  1.     Pleaee  rate  the  strength  or  weakness  of  the  Internal 

control  procedure  relating  to  program  and  data  Integrity. 
(Please   circle  your   response.) 

Very  Very 

Haaj  adequate  Strong 

-4         -3         -2         -1       •         +1         +2         +3         +4 

Question  2.     Mot  referring  to  the  specific  procedure  described 
above,  how  important  to  the  overall  system  of  internal 
controls  is  it  to  have  an  adequate  control  procedure 
for  program  and  data  Integrity?      (please  circle 
your   response.) 

Hot  Very  Very 

Tanortant  Tmpnrtant 

I  +1  +2  +3  +4 

The  following  eicerpt  from  the  external  auditor's  management 
letter  was  passed  on  to  you: 

UTERNAL    AUDITOR'S   RECOMKEKDATIOK 

we  recommend  that  the  software  librarian  be  trained  as  a 
computer  operator  in  addition  to  his  current  duties,   so  that  be  can 
diversify  hie  time  across  job  functions  ac    is  needed. 

Rote:  The  external  auditor  views  this  change  as  relatively  Bfii£ 
critical  than  changes  recommended  in  prior  years. 

Question  3.     Assuming  the  change  is  Implemented,  how  would  you 

evaluate  the  strength  of  the  program  and  data  integrity 
Internal  control  procedure?      (Please  circle  your  response.) 


Very 

Very 

Weak 

Ad»auat-e 

Bt  rang 

-4 

-3 

-2 

-1    f     +1 

+2 

+3 

+4 
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Question  4.     Claasify  the  recommended  change.      (Please  refer   to 
the  definitions  of  desirable  and  undesirable  on  the 
cover   sheet,    and  circle  your   response.) 

a.  addition  of  a  desirsble  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  a  desirable  control 

d.  deletion  of  an  undesirable  control 

a.  a  simultaneous  deletion  of  an  undesirable  control 
airp  the  addition  of  an  undesirable  control 

t.  a  simultaneous  deletion  of  an  undesirable  control 
JUTS  the  addition  of  a  desirable  control 

Question  5.      In  order  for  ua  to  gauge  the  relative  lsiportance  of 

factors  that  will  influence  your  decision  concerning  the 
recommended  change,   pleaae  allocate  MB  points  to  the 
following  factorai 

The  source  of  the  recommendation 

(the   asternal  auditor)  — 


The  tone  of  the  recommendation  

Tour  own  assessment,   of  the  economic  cost-benefit 

Impact  on  your  company  from  the  change  

Other  factors   (please  specify  below)  

Total   (must  add  to  lis)  1M  points 

Other   factors: - — - 

Question  6.     If  the  recommended  change  were  Implemented,   In  your 
opinion  how  would  the  change  affect  the  quality  of  the 
overall  system  of   Internal  control?      (Please  circle  your 
response.) 

Greatly  Greatly 

Reduce                                  Internal  Improve 

Internal                              Control  Internal 

Control                                      imaffctsd  Control 

-4         -3  -2       -1         I         +1  +2         +3           +4 

Question  7.     What  would  you  communicate  to  the  audit  committee  about 
the  recommended  change?     (Pleaae  circle  your   response.) 

Strongly  Strongly 

Recommend  Recommend 

Reaction  Acceptance 

-4  -3  -2        -1  f  +1        +2  +3  +4 
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Beta  Co. —  rile  Disaster  Recovery  Procedure 

The  company's  current  practice  la  to  maintain  both  accounts 
receivable  records  and  tranaactions  en  tapes.     The  master  file  la 
updated  each  business  day.      Company  policy  la  to  file,    In  fireproof 
containers,    old  Batter  files  and  tranaactlon  files  for  a  six-month 
period,   before  reusing  the  tapes. 

Question  1.     Please  rste  the  strength  or  weakness  of  the  Internal 
control  procedure  relating  to  file  diaaster  recovery. 
(Please    circle  your   response.) 

Very  Very 

Weak  adequate  Strong 

-4    -3    -2    -1   I    41    +2    +3    44 

Question  2.     Mot  referring  to  the  specific  procedure  described 
above,  how  important  to  the  overall  system  of  internal 
controls  Is  it  to  have  an  adequate  control  procedure 
for  file  dlaaater  recovery?      (Please   circle 
your  response.) 

Hot  Very  Very 

Important  Important 

•  +1  42  +3  44 

The  following  excerpt  fro*  the  external  auditor's  managenent 
letter  was  passed  on  to  you: 

EXTERUAL    AUDITOR' 6    MCOIWENDATION 

You  are  maintaining  too  many  past  tapes;   the  tapes  from  the 
three  aost  recent  business  days  would  be  adequate. 

Rote:  The  external  auditor  views  this  change  as  relatively  iUI 
critical  than  changes  recomnended  in  prior  years. 

Question  3.     Assuming  the  change  is  implemented,   bow  would  you 
evaluate  the  strength  of  the  file  disaster  recovery 
internal   control   procedure?      (Please  circle  your   response.) 

Very  Very 

Jieifc  adequate  Btrnng 

-4         -3         -2         -1       ■         +1         +2         *3         44 
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Question  4.      Classify  tbe  recoaaended  change.      (Please  refer  to 
the  definitions  of  desirable  and  undesirable  on  the 
cover  sheet,   and  circle  your  response.) 

a.  addition  of  a  desirable  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  a  desirable  control 

d.  deletion  of  an  undeairable  control 

e.  a  aiaultaneous  deletion  of  an  undesirable  control 
IID  tbe  addition  of  an  undesirable  control 

f.  a  aiaultaneous  deletion  of  an  undesirable  control 
Jutd  the  addition  of  a  desirable  control 

Question  5.     In  order  for  us  to  gauge  the  relative  laportance  of 

factors  that  will  influence  your  decision  concerning  the 
recoaaended  change,    please  allocate  KB  points  to  the 
following  factors i 

The  source  of  the  recoaaendation 

(the   external  auditor)  


The  tone  of  the  recoaaendation  

Tour  own  assesaaent  of  the  econoalc  cost-benefit 

lapect  on  your  coapany  froa  the  change  

Other  factora    (please  apecify  below)  

Total    (aust  add  to  II")  1st  points 

Other  fsctors: 

Question  6.     If  the  recoaaended  change  were  iapleaented,    in  your 
opinion  how  would  the  change  affect  the  quality  of  the 
overall  aystea  of   internal  control?      (Please  circle  your 
response.) 

Greatly  Greatly 

Reduce  Internal                                   Iaprove 

Internal  Control                                     Internal 

Central  nnafrVctad                          Control 

-4         -3  -2       -1          1          +1  42          43            +4 

Question  7.     What  would  you  coaaunlcate  to  the  audit  coaaittee  about 
the  recoaaended  change?     (Pleaae  circle  your  response.) 

Strongly  Strongly 

Recoaaend  Recoaaend 

R»  ■Wet  Ian  RXStPtanCt 

-4         -3  -2       -1  •  +1        +2  43  44 
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receivable  record,  and  tr.neactlona  on  tap. a.     »«■••*«£  |t^'  rSoe 

period,   before  reuelng  the  tapea. 

«_.»<.».  l       Meaae  rate  the  atrength  or  weaknees  of  the  Internal 
•"■tl0D     centr"  procedu".  relating  to  file  diaa.t.r  r.eov.ry. 
(Pleaae   circle  your   reaponae.) 


Very 


Question  2. 


The  following  eacerpt  fro.  the  external  audltor-e  -enage.ent 
letter  was  paaaed  on  to  youi 

KHERHM.  maWVB  "»mI?°*"™     ....t  ♦.„,.     lri  the  event  of  an 

.odder  s  walSHSSfflass  »* 

^t^^ao  ^o^end^"'."  oriTfnil.s  U,.t  you  do  .alnt.in 
be^"pt  in  a  aeparat.  building  fro.  the  current  fUea. 

»et. .  the  aat.rna!  auditor  vl...  thl.  Chang,  a.  relatively  ua 
critical  than  changea  reeom.nded  In  prior  yeara. 

Very 

"^       -3  -2         -li+1  +2  +3  +4 


177 


C1P46    (2) 

Question  4.     Classify  the  recommended  change.      (Please  refer  to 
the  definitions  of  desirable  and  undesirable  on  the 
cover  sheet,    and  circle  your  response.) 

a.  addition  of  a  desirable  control 

b.  addition  of  an  undesirable  control 

c.  deletion  of  a  desirable  control 

a.     deletion  of  an  undesirable  control 

a.     a  simultaneous  deletion  of  an  undesirable  control 

MR)  the  addition  of  an  undesirable  control 
f.     a  simultaneous  deletion  of  an  undesirable  control 

MR)  the  addition  of  a  desirable  control 

Question  S.     In  order  for  us  to  gouge  the  relative  importance  of 

factora  that  will   influence  your  decision  concerning  the 
recommended  change,  pleaae  allocate  lit  points  to  the 
following  factors: 

The  source  of  the  recommendation 

(the   asternal  auditor)  — 


The  tone  of  the  recommendation  

Tour  own  assessment  of  the  economic  cost-benefit 

Impact  on  your  company  from  the  change  — _ _» 

Other  factors   (pleaae  specify  below)  _ _ 

Total  (must  add  to  Iff)  »••  points 


Other  factors:. 


Question  C.     If  the  recommended  change  were  implemented.   In  your 
opinion  how  would  the  change  affect  the  quality  of  the 
overall  system  of  Internal  control?      (Please  circle  your 
response.) 

Greatly 
Improve 
Internal 
pontrol 
♦2         43  +4 


Greatly 

Reduce 

Internal 

Internal 

Control 

rontrol 

Unaffected 

-4         -3 

-2 

-1        1       +l 

Question  7.     Whst  would  you  communlcste  to  the  audit  committee  about 
the  recommended  change?     (Please  circle  your   response. ) 


■trongly 
la commend 

Ittectlpn 
-4         -3 


-2       -1 


♦1 


■trongly 

Recommend 

acceptance 

43     44 


APPENDIX  C 
ADDITIONAL  QUESTIONS 


The  next  two  pages  contain  xerographically  reduced  copies 
of  the  additional  questions  that  were  the  final  two  pages  of 
the  experimental  instrument. 


178 


179 


ttiank  you  for  your  help  »o  far.      Please  answer  a  few  »ore  questions. 

1.       In  general,  would  you  consider  participating  in  another 

experiment  if  another   researcher  requests  your  assistance? 

Please  circle  one:     yes  no 


Please  comment  on  the  clarity  of  the  Internal  control 
descriptions  and  the  meaning  of  the  questions  that  followed 
each   description. 


3.  Bow  confident  are  you  of  your   responses? 
Please  circle  one: 

a.  not  too  confident 

b.  fairly  confident 

c.  very  confident 

4.  Bave  you  ever  worked  as  a  public  accountant? 
Please  circle  one:  yes  no 

5.  1  have  worked  years  as  an  accountant  or  auditor. 


Bave  you  had  any  training  in  electronic  data  processing  or 
computer  related  functions?     If  so,  was  your  training  formal 
or  informal? 
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7.       Please  describe  how  faaillar  you  ire  with  the  Internal 
control   procedures  that  occurred  In  the  experiment. 


Please  check  the  position  that  aost  closely  describes  your   job. 

entry  level 

senior  level 

aanager 

senior  aanager 

assistant  vice  president 

_  vice  president 
president 


I.  What  is  the  employment  position  of  the  person  to  whom  you 
report?     Check  one. 

senior  level 

aanager 

__  senior  aanager 

assistant  vice  president 

vice  president 

president 

II.  Soae  of  the  external  auditor's  recoaaendationa  were  stronger  than 
ethers.     Bow  important  do  you  believe  the  strength  of  the 
recoaaendation  waa  in  influencing  your    judgment? 

■ot  Very 

laPBrtint  Iroorunt 

-4       -3       -2       -1       •         +1       42       «       +4 


APPENDIX  D 
EXPLANATION  OF  ADDITIONAL  QUESTIONS 


The  following  is  a  brief  description  of  the  additional 
questions  which  each  subject  answered  after  completing  the 
four  scenarios  to  which  he  was  assigned.  The  two  pages  of 
the  questionnaire  associated  with  these  descriptions  are 
found  in  Appendix  C. 

Participate  again.   Subjects  were  asked  to  respond 
■yes"  or  "no"  to  the  question:   "In  general,  would  you 
consider  participating  in  another  experiment  if  another 
researcher  requested  your  assistance?" 

Clarity.  Subjects  were  asked  an  open-ended  question 
about  the  clarity  of  the  internal  control  questions  and  the 
meaning  of  the  questions  that  they  had  been  asked. 

Confidence.  Subjects  were  asked  to  rate  their 
confidence  in  their  own  answers.   They  were  given  the 
following  choices:  "not  too  confident",  "fairly  confident", 
and  "very  confident". 

Public  accounting  experience.  Subjects  were  asked  if 
they  had  ever  worked  as  public  accountants.   Response 
options  were  "yes"  or  "no". 
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Experience.     Subjects  were  asked  the  number   of  years 
that   they  had  worked  as  accountants  or   as  auditors. 

Training.  Subjects  were  asked  an  open-ended  question 
about  the  amount  of  EDP  training,    formal  and  informal,    that 
they   had   received. 

Familiarity  with  controls.     Subjects  were  asked  an 
open-ended  question  about  their  familiarity  with   the 
controls   discussed   in  the  experiment. 

Work  level.     Subjects  were  asked  to   provide  information 
concerning  their   relative  work  positions.     They  were 
provided  with  a   scale  from  entry  level   to   president. 

Reporting   level.     Subjects  were  asked  to  provide 
information  concerning  the  position  of   their  work 
supervisor.     They   were  given  a   scale  from   senior   level    to 
president. 

Impact  o_£  tone  manipulation.     Subjects  were  asked  to 
rate   the  influence   that  the   strength   of   the  external 
authority's   recommendation  had  on  the  subject's  own  decision 
to  accept   or   reject  the   proposed  change.      They  were  asked  to 
respond  on  a  nine-point   scale,    which   ranged  from   "not 
important"    (-4)    to    "very    important"    (+4). 


APPENDIX   E 
PRE-TESTING 


In  developing  the  scenarios  and  questions,    three  pilot 
tests  were  administered.     At   the   conclusion  of   the   pilot 
testing,    a  field  trial   was   run.      As  a   result  of   the  pilot 
testing  and  field  trial,   modifications  were  made   to  the 
experimental    instrument  and  the  experimental  design. 

The  first  pilot  test  was  administered  to  an 
undergraduate   auditing  class.      Four   different   corporate 
structures  were   used    (pre-testing  and  revision  reduced  this 
to   one   corporate   structure   in  the  final    instrument).      The 
results  of   the   pilot   test  led  to:    a   reduction  in  the 
experimental   design,    a  revision  of   the  form  of   the 
experimental  design,    and  a  more  careful  examination  of   the 
content    of    the   scenarios. 

The   second  pilot  test  was  designed  to  confirm  the 
reasonableness  of   the  experimenter's   classification   of    the 
type   of   control   manipulation  in  the   scenarios.      Subjects, 
Ph.D.    students,    were  asked  to  read  the  scenarios  and   place 
them   face   down  into  piles  according  to  how   they  classified 
the  recommended  changes.      While  there  were  four  correct 
classifications,    six  options  were  given.     Of   the  84    responses, 
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thirty-three  were  misclassif  ied.      Some  of   the  misclassif ied 
results  were  not  logical.     When  asked  to  explain  them,   the 
subjects  either  described  a  misconception  about   internal 
controls,  said  they  placed  them  in  the  wrong  piles,  or  were 
just   confused.      These  misclassif ications  were  ignored.      Each 
of   the  other  misclassif  ications  was  investigated.      In  the 
case  of  multiple  misclassif  ications,    the  scenarios  were 
rewritten.     After   corrections  were  made,   a   second  version  of 
this   pilot  test  was   run   using  another   Ph.D.    student.      Some 
weaknesses   in  the  experimenter's  classification  of   type   of 
change  were  noted  and  a  few   revisions  were   necessary.      A 
third  version  of   the   second  pilot  test  was  administered  to 
another   Ph.D.    student  who   correctly  classified   all    of   the 
changes   in  the   scenarios.      The  descriptions  of   the  control 
procedures  and  the  recommended  changes  were  not   changed 
after    this   point. 

The   third  pilot  test   used  undergraduate  auditing 
students  as   subjects.      Forty-four   responses  were 
obtained.     The  instrument  and  its  form   seemed  acceptable, 
and  it  was   decided  to   proceed  with  field  testing. 

The  experiment  was  administered  in  a  field  test  to  the 
controller  and  internal   auditing   staff   of  a   software 
manufacturing  company.     The  firm's  accounting  records  were 
fully  computerized.      In  addition,    because   of   the  nature   of 
the  firm's  product,    the   staff   was  predisposed  to  an 
understanding  of   the  experimental    task.     However,    several 
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weaknesses  in  the  experimental  design  attracted  attention 
when  the  data  was  examined.      A  second  external  authority 
(systems  analyst)   was  added  to   provide  a   comparison  for   the 
source  variable.      In  order   to  accommodate   this  change 
without  increasing  the   size   of   the  experiment,    the   second 
company  was  dropped  from  the  design.     Also,    two  more 
dependent  variables  were  added.     The   result  was  the 
experimental    instrument  which   is  found  in  Appendices  A,    B, 
and   C. 


APPENDIX   F 
FORMULAS    FOR    PARTIAL    CORRELATION    COEFFICIENTS 

Hays    [1973,   p.    711]    gives  the  formulation  for   a  partial 
correlation   coefficient  holding   one  variable   constant. 
r12  "    (r13    r23> 


r12.3 


[(l-rf3)(l-r|3)]-5 


Steel   and  Torrie    [1960,    p.    303]    give  the  following 
formulation  for  partial   correlation  holding   two  variables 
constant. 


r12.4   "    <r13.4    r23.4> 
r12.34   "  


[(l-r23#4)(l-r23<4)].5 


Using  the   correlation  coefficients   in  Table   5-20,    and 
applying  the  formulas  to  the  path  model: 


rti   ~    <rtc   ric> 
:ti.c  "  ■  -.003 


[(l-r£c)(l-r?c)]-5 
rts  "    <rtc   rsc> 


I(l-r2    )(l-r2    )]-5 


i       c ■    -027 


186 


187 


cis  "    <ric   rsc> 


cis.c 


ti.sc 


=    .077 


[(l-r?c)(l-r2c)]-5 

.        rti.c  "    (rts.c  ris.c) 
t<1-*ts.cHl-rf8.c)]-5 


-.005 


rsi.c   "    <r 


si.  tc 


st.c   lit.c' 


[(l-r2t>c)(l-r?t<c)] 


.077 
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